 Georgi Gerganov
|
494c870326
ggml : fix IQ3_S AVX implementation (#5834)
|
1 year ago |
 Kawrakow
|
bbde6eb256
ggml : IQ3_S improvements (#5829)
|
1 year ago |
|
Kawrakow
|
7c4263d426
ggml : make i-quants work with super-blocks of 64 (CPU,Metal) (#5760)
|
1 year ago |
|
Kawrakow
|
cb49e0f8c9
Attempt to fix android build (#5752)
|
1 year ago |
|
Kawrakow
|
0becb22ac0
IQ4_XS: a 4.25 bpw quantization (#5747)
|
1 year ago |
 Engininja2
|
1f30b7a9f1
ggml-quants : fix avx2 iq1_s vec_dot when compiled with gcc (#5742)
|
1 year ago |
|
Kawrakow
|
a33e6a0d2a
Adding IQ2_S and IQ2_M to complete coverage of the 2-3 bit quantization range (#5721)
|
1 year ago |
 Radosław Gryta
|
abbabc5e51
ggml-quants : provide ggml_vqtbl1q_u8 for 64bit compatibility (#5711)
|
1 year ago |
|
Kawrakow
|
4c4cb30736
IQ3_S: a much better alternative to Q3_K (#5676)
|
1 year ago |
|
Georgi Gerganov
|
7e4f339c40
ggml : always define ggml_fp16_t as uint16_t (#5666)
|
1 year ago |
|
Georgi Gerganov
|
efd56b1c21
ggml : 32-bit arm compat (whisper/1891)
|
1 year ago |
|
Kawrakow
|
a14679cc30
IQ4_NL: 4-bit non-linear quants with blocks of 32 (#5590)
|
1 year ago |
|
Georgi Gerganov
|
14278f55d2
ggml : restore vec dot stride arg names (#5453)
|
1 year ago |
|
Georgi Gerganov
|
b1de96824b
ci : fix wikitext url + compile warnings (#5569)
|
1 year ago |
|
Kawrakow
|
bd2d4e393b
1.5 bit quantization (#5453)
|
1 year ago |
|
Kawrakow
|
895407f31b
ggml-quants : fix compiler warnings (shadow variable) (#5472)
|
1 year ago |
|
Georgi Gerganov
|
0f2411f154
ggml : fix compile warnings (unused vars) (#4966)
|
1 year ago |
 snadampal
|
a07d0fee1f
ggml : add mmla kernels for quantized GEMM (#4966)
|
1 year ago |
 Michael Podvitskiy
|
b2f87cb64d
ggml : fix `error C2078: too many initializers` for MSVC ARM64 (#5404)
|
2 years ago |
|
Kawrakow
|
f57fadc009
Slight quantization improvement for Q4_K and Q5_K (#5361)
|
2 years ago |
|
Kawrakow
|
6fdfa2ecc6
iq2_xxs: tune quantization (#5320)
|
2 years ago |
|
Kawrakow
|
8e14e3ddb3
Faster AVX2 dot product for IQ2_XS (#5187)
|
2 years ago |
|
Kawrakow
|
f4d7e54974
SOTA 3-bit quants (#5196)
|
2 years ago |
|
Georgi Gerganov
|
38566680cd
ggml : add IQ2 to test-backend-ops + refactoring (#4990)
|
2 years ago |
|
Kawrakow
|
334a835a1c
ggml : importance matrix support for legacy quants (#4969)
|
2 years ago |
|
Kawrakow
|
467a882fd2
Add ability to use importance matrix for all k-quants (#4930)
|
2 years ago |
|
Kawrakow
|
147b17ac94
2-bit quantizations (#4897)
|
2 years ago |
|
Georgi Gerganov
|
f238461236
ggml : fix 32-bit ARM compat for IQ2_XS (whisper/1758)
|
2 years ago |
|
Kawrakow
|
49662cbed3
ggml : SOTA 2-bit quants (add IQ2_XS) (#4856)
|
2 years ago |
|
Georgi Gerganov
|
18c2e1752c
ggml : fix vld1q_s8_x4 32-bit compat (#4828)
|
2 years ago |
