 Pierrick Hymbert
|
e3965cf35a
server: tests - slow inference causes timeout on the CI (#5715)
|
1 rok temu |
|
Pierrick Hymbert
|
8b350356b2
server: docs - refresh and tease a little bit more the http server (#5718)
|
1 rok temu |
 Georgi Gerganov
|
bf08e00643
llama : refactor k-shift implementation + KV defragmentation (#5691)
|
1 rok temu |
 compilade
|
f7625019c5
server : fix crash when system prompt is bigger than batch size (#5714)
|
1 rok temu |
 Radosław Gryta
|
abbabc5e51
ggml-quants : provide ggml_vqtbl1q_u8 for 64bit compatibility (#5711)
|
1 rok temu |
 kwin1412
|
f1a98c5254
make : fix nvcc version is empty (#5713)
|
1 rok temu |
 Ashok Gelal
|
7d548a1827
readme : add Msty to UI list (#5618)
|
1 rok temu |
|
Pierrick Hymbert
|
930b178026
server: logs - unified format and --log-format option (#5700)
|
1 rok temu |
|
Pierrick Hymbert
|
d52d7819b8
server: concurrency fix + monitoring - add /metrics prometheus compatible endpoint (#5708)
|
1 rok temu |
|
Radosław Gryta
|
1289408817
cmake : fix compilation for Android armeabi-v7a (#5702)
|
1 rok temu |
|
Georgi Gerganov
|
ab336a9d5e
code : normalize enum names (#5697)
|
1 rok temu |
 Anas Ahouzi
|
69917dfa55
py : fix StableLM conversion after config.json changes (#5703)
|
1 rok temu |
|
Pierrick Hymbert
|
9e359a4f47
server: continue to update other slots on embedding concurrent request (#5699)
|
1 rok temu |
 Kawrakow
|
4c4cb30736
IQ3_S: a much better alternative to Q3_K (#5676)
|
1 rok temu |
|
Pierrick Hymbert
|
525213d2f5
server: init functional tests (#5566)
|
1 rok temu |
 AlpinDale
|
fd43d66f46
server : add KV cache quantization options (#5684)
|
1 rok temu |
 Jared Van Bortel
|
54fbcd2ce6
convert : fix missing ftype for gemma (#5690)
|
1 rok temu |
|
Jared Van Bortel
|
15499eb942
mpt : do not duplicate token_embd.weight on disk (#5670)
|
1 rok temu |
|
Georgi Gerganov
|
96633eeca1
gemma : use more bits for the token_embd.weight tensor (#5650)
|
1 rok temu |
|
Georgi Gerganov
|
847eedbdb2
py : add Gemma conversion from HF models (#5647)
|
1 rok temu |
|
Georgi Gerganov
|
7e4f339c40
ggml : always define ggml_fp16_t as uint16_t (#5666)
|
1 rok temu |
|
Georgi Gerganov
|
334f76fa38
sync : ggml
|
1 rok temu |
|
Georgi Gerganov
|
efd56b1c21
ggml : 32-bit arm compat (whisper/1891)
|
1 rok temu |
 Someone
|
201294ae17
nix: init singularity and docker images (#5056)
|
1 rok temu |
|
Georgi Gerganov
|
5a9e2f60ba
py : minor fixes (#5668)
|
1 rok temu |
 Xuan Son Nguyen
|
373ee3fbba
Add Gemma chat template (#5665)
|
1 rok temu |
|
Someone
|
4cb4d8b22d
workflows: nix: hardcode cachix ids, build unconditionally (#5663)
|
1 rok temu |
|
Georgi Gerganov
|
3a03541ced
minor : fix trailing whitespace (#5638)
|
1 rok temu |
|
Georgi Gerganov
|
56d03d92be
readme : update hot topics
|
1 rok temu |
|
Xuan Son Nguyen
|
a46f50747b
server : fallback to chatml, add AlphaMonarch chat template (#5628)
|
1 rok temu |
