Georgi Gerganov
|
9ebebef62f
llama : remove KV cache defragmentation logic (#15473)
|
4 ヶ月 前 |
Diego Devesa
|
54a241f505
sched : fix possible use of wrong ids tensor when offloading moe prompt processing (#15488)
|
4 ヶ月 前 |
Jie Fu (傅杰)
|
ec5ab1a36c
common : fix context shift help message (#15448)
|
4 ヶ月 前 |
Gian-Carlo Pascutto
|
1e19f5d462
common : Add top-nsigma sampler to help globally (#15428)
|
5 ヶ月 前 |
Georgi Gerganov
|
d2fcd91cf9
server : disable context shift by default (#15416)
|
5 ヶ月 前 |
Georgi Gerganov
|
d32e03f449
server : add SWA checkpoints (#15293)
|
5 ヶ月 前 |
Jonathan Graehl
|
5cdb27e091
finetune: SGD optimizer, more CLI args (#13873)
|
5 ヶ月 前 |
Sigbjørn Skjæret
|
b3e16665e1
server : enable -td and -tbd parameters (#15172)
|
5 ヶ月 前 |
Copilot
|
d8914fc47e
common : add --override-tensor-draft, --cpu-moe-draft and --n-cpu-moe-draft parameters (#15191)
|
5 ヶ月 前 |
Xuan-Son Nguyen
|
53d0a12658
server : allow specifying reasoning_format in HTTP request (#15238)
|
5 ヶ月 前 |
Georgi Gerganov
|
fd1234cb46
llama : add gpt-oss (#15091)
|
5 ヶ月 前 |
Diego Devesa
|
ec428b02c3
llama : add --n-cpu-moe option (#15077)
|
5 ヶ月 前 |
compilade
|
19f68fa5a4
imatrix : warn when GGUF imatrix is saved without .gguf suffix (#15076)
|
5 ヶ月 前 |
compilade
|
d31192b4ee
imatrix : use GGUF by default (#14842)
|
5 ヶ月 前 |
Diego Devesa
|
a06ed5feae
llama : add simple option to enable CPU for MoE weights (--cpu-moe) (#14992)
|
5 ヶ月 前 |
Diego Devesa
|
d6818d06a6
llama : allow other bufts when overriding to CPU, add --no-repack option (#14990)
|
5 ヶ月 前 |
g2mt
|
94933c8c2e
server : implement universal assisted decoding (#12635)
|
5 ヶ月 前 |
Aman Gupta
|
8a4a856277
Add LLaDA 8b Diffusion model (#14771)
|
5 ヶ月 前 |
Ed Addario
|
d1aa0cc5d1
imatrix: add option to display importance score statistics for a given imatrix file (#12718)
|
5 ヶ月 前 |
Molly Sophia
|
adef81781a
server : allow setting `--reverse-prompt` arg (#14799)
|
5 ヶ月 前 |
Georgi Gerganov
|
225e7a1438
llama : add high-throughput mode (#14363)
|
6 ヶ月 前 |
Aman Gupta
|
ab14019821
Support diffusion models: Add Dream 7B (#14644)
|
6 ヶ月 前 |
Alawode Oluwandabira
|
17a1f0d2d4
server: Add ability to mount server at prefix (#14544)
|
6 ヶ月 前 |
matteo
|
caf5681fcb
server : support jinja extra template kwargs (Qwen3 enable_thinking feature), from command line and from client (#13196)
|
6 ヶ月 前 |
Sigbjørn Skjæret
|
88fc854b4b
llama : improve sep token handling (#14272)
|
7 ヶ月 前 |
aa956
|
d67341dc18
server : add server parameters for draft model cache type (#13782)
|
7 ヶ月 前 |
Georgi Gerganov
|
d3e64b9f49
llama : rework embeddings logic (#14208)
|
7 ヶ月 前 |
Olivier Chafik
|
c9bbc77931
`server`: update deepseek reasoning format (pass reasoning_content as diffs) (#13933)
|
7 ヶ月 前 |
Max Krasnyansky
|
053b1539c0
threading: support for GGML_SCHED_PRIO_LOW, update thread info on Windows to avoid throttling (#12995)
|
7 ヶ月 前 |
Georgi Gerganov
|
53f925074d
sync : vendor (#13901)
|
7 ヶ月 前 |