 Stephan Walter
|
36d19a603b
Remove Q4_3 which is no better than Q5 (#1218)
|
2 years ago |
 Evan Jones
|
1481a9cf25
llama : add session file format and saved sessions in main (#1169)
|
2 years ago |
 Georgi Gerganov
|
574406dc7e
ggml : add Q5_0 and Q5_1 quantization (#1187)
|
2 years ago |
 Ásgeir Bjarni Ingvarsson
|
87a6f846d3
Allow setting the rng seed after initialization. (#1184)
|
2 years ago |
|
Georgi Gerganov
|
7a32fcb3b2
ggml : add Q8_0 quantization format (rename the old one to Q8_1) (ARM NEON) (#1179)
|
2 years ago |
|
Georgi Gerganov
|
c4fe84fb0d
llama : refactor get / set state + remove redundant kv cache API (#1143)
|
2 years ago |
 xaedes
|
b6e7f9b09e
llama : add api for getting/setting the complete state: rng, logits, embedding and kv_cache (#1105)
|
2 years ago |
 Kawrakow
|
38de86a711
llama : multi-threaded quantization (#1075)
|
2 years ago |
|
Georgi Gerganov
|
e0305ead3a
ggml : add Q4_3 quantization (#1082)
|
2 years ago |
|
Georgi Gerganov
|
77a73403ca
ggml : add new Q4_2 quantization (ARM only) (#1046)
|
2 years ago |
 slaren
|
315a95a4d3
Add LoRA support (#820)
|
2 years ago |
|
Georgi Gerganov
|
9190e8eac8
llama : merge llama_internal.h into llama.h
|
2 years ago |
|
Stephan Walter
|
e7f6997f89
Don't crash on ftype (formerly f16) == 4 (#917)
|
2 years ago |
|
Stephan Walter
|
3e6e70d8e8
Add enum llama_ftype, sync ggml_type to model files (#709)
|
2 years ago |
 comex
|
f963b63afa
Rewrite loading code to try to satisfy everyone:
|
2 years ago |
 unbounded
|
62cfc54f77
Add quantize-stats command for testing quantization (#728)
|
2 years ago |
 Christian Falch
|
e986f94829
Added api for getting/setting the kv_cache (#685)
|
2 years ago |
 Justine Tunney
|
78ca9838ee
Make loading weights 10-100x faster
|
2 years ago |
 anzz1
|
a5c42c4b13
Fix typo in llama.h (#593)
|
2 years ago |
|
anzz1
|
7f4c5c6651
llama : fix linkage with mingw (#551)
|
2 years ago |
|
Stephan Walter
|
436e561931
all : be more strict about converting float to double (#458)
|
2 years ago |
|
Stephan Walter
|
c1f885067c
ggml : introduce structs for the q4 data blocks (#356)
|
2 years ago |
|
Georgi Gerganov
|
03f7e33560
Cleanup STL headers + fix embedding examples + minor stuff
|
2 years ago |
 Jed Fox
|
58e6c9f36f
Add support for file load progress reporting callbacks (#434)
|
2 years ago |
 Doomsdayrs
|
36d07532ef
Add missing struct annotation (#483)
|
2 years ago |
|
comex
|
563cdc391d
Support calling mlock() on loaded model data on Linux and macOS (#453)
|
2 years ago |
 Luciano
|
8d4a855c24
Add embedding mode with arg flag. Currently working (#282)
|
2 years ago |
|
Georgi Gerganov
|
f5a77a629b
Introduce C-style API (#370)
|
2 years ago |
