 Justine Tunney
|
8cc91dc63c
ggml : add llamafile sgemm (#6414)
|
hai 1 ano |
 Carolinabanana
|
5dc9dd7152
llama : add Command R Plus support (#6491)
|
hai 1 ano |
 Kawrakow
|
cbc8343619
Make IQ1_M work for QK_K = 64 (#6327)
|
hai 1 ano |
|
Kawrakow
|
55c1b2a3bb
IQ1_M: 1.75 bpw quantization (#6302)
|
hai 1 ano |
 Justine Tunney
|
7733f0c760
ggml : support AVX512VNNI (#6280)
|
hai 1 ano |
|
Kawrakow
|
cfd3be76e3
ggml : same IQ4_NL quantization for CPU/CUDA/Metal (#6196)
|
hai 1 ano |
 Georgi Gerganov
|
8030da7afe
ggml : reuse quantum structs across backends (#5943)
|
hai 1 ano |
|
Georgi Gerganov
|
184215e783
ggml : fix UB in IQ2_S and IQ3_S (#6012)
|
hai 1 ano |
|
Kawrakow
|
44ca159faf
1.5 bit: we can do even better (#5999)
|
hai 1 ano |
 Michael Podvitskiy
|
3202361c5b
ggml, ci : Windows ARM runner and build fixes (#5979)
|
hai 1 ano |
|
Kawrakow
|
be858f6205
Better 1.5 bit quantization (#5971)
|
hai 1 ano |
|
Georgi Gerganov
|
df4dc3e7cb
ggml : try fix 32-bit arm compat (whisper/1938)
|
hai 1 ano |
|
Georgi Gerganov
|
8380ecfb21
ggml : fix unnecessary f32 -> f16 -> f32 casts (mmla) (#5951)
|
hai 1 ano |
|
Georgi Gerganov
|
5b09797321
ggml : remove old quantization functions (#5942)
|
hai 1 ano |
|
Georgi Gerganov
|
8a3012a4ad
ggml : add ggml-common.h to deduplicate shared code (#5940)
|
hai 1 ano |
 bobqianic
|
e25fb4b18f
ggml : use `uint8x16_t` return type for `ggml_vqtbl1q_u8` (#5894)
|
hai 1 ano |
 Jared Van Bortel
|
bd836944f8
quants : use MM256_SET_M128I consistently to fix gcc 7 build (#5889)
|
hai 1 ano |
|
Georgi Gerganov
|
494c870326
ggml : fix IQ3_S AVX implementation (#5834)
|
hai 1 ano |
|
Kawrakow
|
bbde6eb256
ggml : IQ3_S improvements (#5829)
|
hai 1 ano |
|
Kawrakow
|
7c4263d426
ggml : make i-quants work with super-blocks of 64 (CPU,Metal) (#5760)
|
hai 1 ano |
|
Kawrakow
|
cb49e0f8c9
Attempt to fix android build (#5752)
|
hai 1 ano |
|
Kawrakow
|
0becb22ac0
IQ4_XS: a 4.25 bpw quantization (#5747)
|
hai 1 ano |
 Engininja2
|
1f30b7a9f1
ggml-quants : fix avx2 iq1_s vec_dot when compiled with gcc (#5742)
|
hai 1 ano |
|
Kawrakow
|
a33e6a0d2a
Adding IQ2_S and IQ2_M to complete coverage of the 2-3 bit quantization range (#5721)
|
hai 1 ano |
 Radosław Gryta
|
abbabc5e51
ggml-quants : provide ggml_vqtbl1q_u8 for 64bit compatibility (#5711)
|
hai 1 ano |
|
Kawrakow
|
4c4cb30736
IQ3_S: a much better alternative to Q3_K (#5676)
|
hai 1 ano |
|
Georgi Gerganov
|
7e4f339c40
ggml : always define ggml_fp16_t as uint16_t (#5666)
|
hai 1 ano |
|
Georgi Gerganov
|
efd56b1c21
ggml : 32-bit arm compat (whisper/1891)
|
hai 1 ano |
|
Kawrakow
|
a14679cc30
IQ4_NL: 4-bit non-linear quants with blocks of 32 (#5590)
|
hai 1 ano |
|
Georgi Gerganov
|
14278f55d2
ggml : restore vec dot stride arg names (#5453)
|
hai 1 ano |
