 Stephan Walter
|
c8c2c52482
AVX2 optimization for vec_dot_q4_2_q8_0 (#1068)
|
2 years ago |
 slaren
|
02d6988121
Improve cuBLAS performance by dequantizing on the GPU (#1065)
|
2 years ago |
 CRD716
|
834695fe3a
Minor: Readme fixed grammar, spelling, and misc updates (#1071)
|
2 years ago |
 Kawrakow
|
f7d05095b4
Q4_2 quantization with rmse-optimized scale and quants (#1062)
|
2 years ago |
 Georgi Gerganov
|
884e7d7a2b
ggml : use 8-bit precision for Q4_1 intermediate results (#1047)
|
2 years ago |
|
Georgi Gerganov
|
7cd5c4a3e9
readme : add warning about Q4_2 and Q4_3
|
2 years ago |
|
Stephan Walter
|
f3d4edf504
ggml : Q4 cleanup - remove 4-bit dot product code (#1061)
|
2 years ago |
|
slaren
|
8944a13296
Add NVIDIA cuBLAS support (#1044)
|
2 years ago |
|
slaren
|
6667401238
Multi-threaded ggml_cpy (#1035)
|
2 years ago |
|
Georgi Gerganov
|
77a73403ca
ggml : add new Q4_2 quantization (ARM only) (#1046)
|
2 years ago |
|
Georgi Gerganov
|
50a8a2af97
ggml : scratch that - vmlaq_n_f32 is always better
|
2 years ago |
|
Georgi Gerganov
|
4caebf6d40
gitignore : vdot
|
2 years ago |
|
Georgi Gerganov
|
dcdd65e296
ggml : optimize ggml_vec_dot_q4_0_q8_0() using vectorized accumulators
|
2 years ago |
|
Kawrakow
|
5ecff35151
Adding a simple program to measure speed of dot products (#1041)
|
2 years ago |
|
Georgi Gerganov
|
7faa7460f0
readme : update hot topics about new LoRA functionality
|
2 years ago |
|
Georgi Gerganov
|
5af8e32238
ci : do not run on drafts
|
2 years ago |
 Ivan Komarov
|
42747220b4
Do not close file after mmap (Windows version) (#1034)
|
2 years ago |
 Atsushi Tatsuma
|
e9298af389
readme : add Ruby bindings (#1029)
|
2 years ago |
 Cameron
|
4ad73137a1
add 4_0 to default outfile namestr dict (#1031)
|
2 years ago |
|
slaren
|
315a95a4d3
Add LoRA support (#820)
|
2 years ago |
 Arik Poznanski
|
efd05648c8
llama : well-defined static initialization of complex objects (#927)
|
2 years ago |
|
Georgi Gerganov
|
eb17a026fd
quantize-stats : fix bug in --type argument
|
2 years ago |
|
Georgi Gerganov
|
69b740289f
ggml : avoid using ggml_fp16_to_fp32() and ggml_fp32_to_fp16() in ggml.c
|
2 years ago |
|
Ivan Komarov
|
f266259ad9
Speedup the AVX-512 implementation of ggml_vec_dot_q4_0() (#933)
|
2 years ago |
|
slaren
|
47f61aaa5f
Fix: do not close file on mmap (#1017)
|
2 years ago |
|
Georgi Gerganov
|
3173a62eb9
stdout : vertical align outputs for better readibility
|
2 years ago |
 Pavol Rusnak
|
489537e6cf
examples: add missing <ctime> include for time() (#1011)
|
2 years ago |
 nanahi
|
2d3481c721
Fix msys2 build error and warnings (#1009)
|
2 years ago |
 comex
|
74f5899df4
convert.py: Fix loading safetensors and ggml format on Windows (#991)
|
2 years ago |
|
Stephan Walter
|
2f7c8e014e
Fix potential int8 overflow in non-SIMD vec_dot (#986)
|
2 years ago |
