slaren
|
097e121e2f
llama : add benchmark example (#2626)
|
2 years ago |
mdrokz
|
eaf98c2649
readme : add link to Rust bindings (#2656)
|
2 years ago |
Georgi Gerganov
|
e9b12c332e
perplexity : more meaningful ETA number - 2 decimal points
|
2 years ago |
Evan Jones
|
604b8bdfa6
Fix unicode in grammars (fixes #2501) (#2553)
|
2 years ago |
staviq
|
10151bee2e
server : support for saving templates in browser LocalStorage (#2486)
|
2 years ago |
Johannes Gäßler
|
0992a7b8b1
README: fix LLAMA_CUDA_MMV_Y documentation (#2647)
|
2 years ago |
Henri Vasserman
|
6ddeefad9b
[Zig] Fixing Zig build and improvements (#2554)
|
2 years ago |
Kerfuffle
|
8dae7ce684
Add --cfg-negative-prompt-file option for examples (#2591)
|
2 years ago |
Georgi Gerganov
|
a73ccf1aa3
llama : replace (permute + reshape + view_1d) with (view_3d) (#2538)
|
2 years ago |
drbh
|
7cf54e1f74
tests : adds simple llama grammar tests (#2618)
|
2 years ago |
Shouzheng Liu
|
a872a2b28e
ggml-alloc : fix discrepency between measure&eval (#2639)
|
2 years ago |
Kolen Cheung
|
0919a0f73d
cmake : install ggml-meta.metal if LLAMA_METAL (#2449)
|
2 years ago |
Jhen-Jie Hong
|
ed53db86c3
metal : print error of load pipeline state (#2564)
|
2 years ago |
Shouzheng Liu
|
fc8ef549e5
metal : enable ggml-alloc (#2627)
|
2 years ago |
Shouzheng Liu
|
bf83bff674
metal : matrix-matrix multiplication kernel (#2615)
|
2 years ago |
Georgi Gerganov
|
b5ffb2849d
scripts : add helper script to get wikitext
|
2 years ago |
Jhen-Jie Hong
|
3ebb00935f
server : add missing /json-schema-to-grammar.mjs (#2616)
|
2 years ago |
Jhen-Jie Hong
|
d783f7982e
metal : return null instead of exit(1) (#2573)
|
2 years ago |
Cheng Shao
|
d75561df20
server : add --numa support (#2524)
|
2 years ago |
Kamil Tomšík
|
348acf188c
llama : add missing enum keyword in function signatures (#2610)
|
2 years ago |
Johannes Gäßler
|
1cd06fa25e
CUDA: launch_bounds, small q4_K, q5_K mmq refactor (#2596)
|
2 years ago |
Jhen-Jie Hong
|
2feb8934eb
server : fix default grammar by use empty string in the UI (#2604)
|
2 years ago |
Jhen-Jie Hong
|
5517d6e692
server : implement json-schema-to-grammar.mjs & add grammar param in the UI (#2588)
|
2 years ago |
vxiiduu
|
f31b539714
Enhance Windows 7 and below compatibility. (#2592)
|
2 years ago |
drbh
|
ee77efea2a
test : add simple grammar parsing tests (#2594)
|
2 years ago |
Johannes Gäßler
|
f64d44a9b9
CUDA: Fixed OpenLLaMA 3b mmq, reduced compile time (#2590)
|
2 years ago |
byte-6174
|
b19edd54d5
Adding support for llama2.c models (#2559)
|
2 years ago |
Equim
|
53dc399472
server: fixed wrong variable name in timing json (#2579)
|
2 years ago |
DannyDaemonic
|
9ca4abed89
Handle `ENABLE_VIRTUAL_TERMINAL_PROCESSING` more gracefully on earlier versions of Windows.
|
2 years ago |
Christian Demsar
|
e59fcb2bc1
Add --n-predict -2 for stopping generation on full context (#2565)
|
2 years ago |