 Georgi Gerganov
|
f914544b16
batched-bench : add "separate text gen" mode (#17103)
|
2 months ago |
 Xuan-Son Nguyen
|
aa3b7a90b4
arg: add --cache-list argument to list cached models (#17073)
|
2 months ago |
|
Georgi Gerganov
|
13b339bcd9
server : do not default to multiple slots with speculative decoding (#17017)
|
2 months ago |
|
Xuan-Son Nguyen
|
070ff4d535
mtmd: add --image-min/max-tokens (#16921)
|
2 months ago |
|
Georgi Gerganov
|
4b2dae383d
common : update presets (#16504)
|
3 months ago |
|
Georgi Gerganov
|
d00cbea63c
server : host-memory prompt caching (#16391)
|
3 months ago |
 Pascal
|
12bbc3fa50
refactor: centralize CoT parsing in backend for streaming mode (#16394)
|
3 months ago |
 Gadflyii
|
3df2244df4
llama : add --no-host to disable host buffers (#16310)
|
3 months ago |
 ddh0
|
f6dcda3900
server : context checkpointing for hybrid and recurrent models (#16382)
|
3 months ago |
 Sigbjørn Skjæret
|
835b2b915c
model : add GroveMoE support (#15510)
|
3 months ago |
 jacekpoplawski
|
8ff206097c
llama-bench: add --n-cpu-moe support (#15952)
|
4 months ago |
|
Sigbjørn Skjæret
|
b8e09f08b9
model : add grok-2 support (#15539)
|
4 months ago |
 Eric Curtin
|
4bf5549269
Add docker protocol support for llama-server model loading (#15790)
|
4 months ago |
|
Georgi Gerganov
|
f088b6a84f
server : adjust prompt similarity thold + add logs (#15913)
|
4 months ago |
|
Georgi Gerganov
|
0d161f021a
server : enable /slots by default and make it secure (#15630)
|
4 months ago |
 Johannes Gäßler
|
e81b8e4b7f
llama: use FA + max. GPU layers by default (#15434)
|
4 months ago |
|
Sigbjørn Skjæret
|
84ab83cc0b
model : jina-embeddings-v3 support (#13693)
|
4 months ago |
|
Georgi Gerganov
|
9ebebef62f
llama : remove KV cache defragmentation logic (#15473)
|
5 months ago |
 Jie Fu (傅杰)
|
ec5ab1a36c
common : fix context shift help message (#15448)
|
5 months ago |
|
Georgi Gerganov
|
d2fcd91cf9
server : disable context shift by default (#15416)
|
5 months ago |
|
Xuan-Son Nguyen
|
e9288e8869
chat : clarify the meaning of reasoning_format (#15408)
|
5 months ago |
|
Georgi Gerganov
|
d32e03f449
server : add SWA checkpoints (#15293)
|
5 months ago |
 Jonathan Graehl
|
5cdb27e091
finetune: SGD optimizer, more CLI args (#13873)
|
5 months ago |
 Copilot
|
d8914fc47e
common : add --override-tensor-draft, --cpu-moe-draft and --n-cpu-moe-draft parameters (#15191)
|
5 months ago |
 Sachin Desai
|
3db4da56a5
chat : support Granite model reasoning and tool call (#14864)
|
5 months ago |
|
Georgi Gerganov
|
fd1234cb46
llama : add gpt-oss (#15091)
|
5 months ago |
 compilade
|
19f68fa5a4
imatrix : warn when GGUF imatrix is saved without .gguf suffix (#15076)
|
5 months ago |
|
compilade
|
d31192b4ee
imatrix : use GGUF by default (#14842)
|
5 months ago |
 Aman Gupta
|
784524053d
Fix params bug in diffusion example (#14993)
|
5 months ago |
 Diego Devesa
|
d6818d06a6
llama : allow other bufts when overriding to CPU, add --no-repack option (#14990)
|
5 months ago |
