 Yishuo Wang
|
c9e2c26f41
A better `packNibbles` and `mul_sum_i8_pairs_float` implementation using AVX512 (#1119)
|
2 jaren geleden |
 Georgi Gerganov
|
0e018fe008
ggml : fix Q4_3 cuBLAS
|
2 jaren geleden |
 Stephan Walter
|
857308d1e8
ci : trigger CI for drafts, but not most PR actions (#1125)
|
2 jaren geleden |
|
Stephan Walter
|
c50b628810
Fix CI: ARM NEON, quantization unit tests, editorconfig (#1122)
|
2 jaren geleden |
 unbounded
|
5f939498d5
ggml : unit test for quantization functions (#953)
|
2 jaren geleden |
 wbpxre150
|
36b4f7e064
llama : print timings on ctrl+c exit (#1021)
|
2 jaren geleden |
 eiery
|
10f19c1121
llama : have n_batch default to 512 (#1091)
|
2 jaren geleden |
 Howard Su
|
7e312f165c
cmake : fix build under Windows when enable BUILD_SHARED_LIBS (#1100)
|
2 jaren geleden |
|
Georgi Gerganov
|
872c365a91
ggml : fix AVX build + update to new Q8_0 format
|
2 jaren geleden |
|
Georgi Gerganov
|
955ef9a5d5
ggml : alternative Q4_3 implementation using modified Q8_0 (#1109)
|
2 jaren geleden |
|
Stephan Walter
|
c5aa5e5777
ggml : AVX2 optimization for vec_dot_q4_3_q8_0 and refactoring (#1099)
|
2 jaren geleden |
 Clint Herron
|
e9a9cb0c54
examples : Improve Alpaca Default Repeat Penalty: Better Match Alpaca.cpp Experience (#1107)
|
2 jaren geleden |
 xaedes
|
b6e7f9b09e
llama : add api for getting/setting the complete state: rng, logits, embedding and kv_cache (#1105)
|
2 jaren geleden |
 slaren
|
50cb666b8a
Improve cuBLAS performance by using a memory pool (#1094)
|
2 jaren geleden |
 apaz
|
25d7abbd1f
llama : fixed rlimit error message (#888)
|
2 jaren geleden |
 源文雨
|
018f2279f5
cmake : link threads publicly to ggml (#1042)
|
2 jaren geleden |
 Alex Klinkhamer
|
9411288271
main : evaluate tokens in batches after swapping context (#1014)
|
2 jaren geleden |
 xaedes
|
8687c1f258
llama : remember and restore kv cache data pointers (#1104)
|
2 jaren geleden |
 Kawrakow
|
1bfc153e2f
ggml : a faster version for Q4_1 x Q8_0 dot products (#1083)
|
2 jaren geleden |
|
slaren
|
3d59769c3b
Show perplexity ETA in hours and minutes (#1096)
|
2 jaren geleden |
|
Georgi Gerganov
|
d40fded93e
llama : fix comment for "output.weight" tensor
|
2 jaren geleden |
|
Stephan Walter
|
2510c1831f
Add ggml-model-*.bin checksums for 7B, 13B, 30B, 65B (#1088)
|
2 jaren geleden |
|
Georgi Gerganov
|
12b5900dbc
ggml : sync ggml (add GPT-NeoX RoPE implementation)
|
2 jaren geleden |
|
Georgi Gerganov
|
9ff334f3c9
ggml : fix bug in ggml_compute_forward_dup_f32()
|
2 jaren geleden |
|
slaren
|
2005469ea1
Add Q4_3 support to cuBLAS (#1086)
|
2 jaren geleden |
|
Georgi Gerganov
|
8a1756abdf
ggml : do not break cuBLAS build (Q4_3 is not yet implemented)
|
2 jaren geleden |
|
Georgi Gerganov
|
66aab46079
ggml : fix Q4_3 quantization
|
2 jaren geleden |
|
Kawrakow
|
38de86a711
llama : multi-threaded quantization (#1075)
|
2 jaren geleden |
|
Georgi Gerganov
|
e0305ead3a
ggml : add Q4_3 quantization (#1082)
|
2 jaren geleden |
 Ivan Komarov
|
6a9661ea5a
ci : remove the LLAMA_ACCELERATE matrix dimension from Ubuntu builds in the CI (#1074)
|
2 jaren geleden |
