Christian Falch
|
e986f94829
Added api for getting/setting the kv_cache (#685)
|
2 years ago |
Justine Tunney
|
78ca9838ee
Make loading weights 10-100x faster
|
2 years ago |
anzz1
|
a5c42c4b13
Fix typo in llama.h (#593)
|
2 years ago |
anzz1
|
7f4c5c6651
llama : fix linkage with mingw (#551)
|
2 years ago |
Stephan Walter
|
436e561931
all : be more strict about converting float to double (#458)
|
2 years ago |
Stephan Walter
|
c1f885067c
ggml : introduce structs for the q4 data blocks (#356)
|
2 years ago |
Georgi Gerganov
|
03f7e33560
Cleanup STL headers + fix embedding examples + minor stuff
|
2 years ago |
Jed Fox
|
58e6c9f36f
Add support for file load progress reporting callbacks (#434)
|
2 years ago |
Doomsdayrs
|
36d07532ef
Add missing struct annotation (#483)
|
2 years ago |
comex
|
563cdc391d
Support calling mlock() on loaded model data on Linux and macOS (#453)
|
2 years ago |
Luciano
|
8d4a855c24
Add embedding mode with arg flag. Currently working (#282)
|
2 years ago |
Georgi Gerganov
|
f5a77a629b
Introduce C-style API (#370)
|
2 years ago |