Gadflyii
|
3df2244df4
llama : add --no-host to disable host buffers (#16310)
|
3 bulan lalu |
Radoslav Gerganov
|
898acba681
rpc : add support for multiple devices (#16276)
|
3 bulan lalu |
ddh0
|
f6dcda3900
server : context checkpointing for hybrid and recurrent models (#16382)
|
3 bulan lalu |
Adrien Gallouët
|
4201deae9c
common: introduce http.h for httplib-based client (#16373)
|
3 bulan lalu |
Adrien Gallouët
|
bf6f3b3a19
common : disable progress bar without a tty (#16352)
|
3 bulan lalu |
Adrien Gallouët
|
364a7a6d4a
common : remove common_has_curl() (#16351)
|
3 bulan lalu |
Adrien Gallouët
|
3c62aed89f
common : simplify etag tracking by removing json (#16342)
|
3 bulan lalu |
Adrien Gallouët
|
b995a10760
common : use cpp-httplib as a cURL alternative for downloads (#16185)
|
3 bulan lalu |
Adrien Gallouët
|
37a23c17bd
common : enable `--offline` mode without curl support (#16137)
|
3 bulan lalu |
Haiyue Wang
|
d05affbab7
common : remove unused local variables (#16140)
|
3 bulan lalu |
Eric Curtin
|
4ca088b036
Add resumable downloads for llama-server model loading (#15963)
|
4 bulan lalu |
jacekpoplawski
|
8ff206097c
llama-bench: add --n-cpu-moe support (#15952)
|
4 bulan lalu |
Aman Gupta
|
6d758839ff
Add LLaDA-7b-MoE diffusion model (#16003)
|
4 bulan lalu |
Diego Devesa
|
50f4281a6f
llama : allow using iGPUs with --device (#15951)
|
4 bulan lalu |
Eric Curtin
|
4bf5549269
Add docker protocol support for llama-server model loading (#15790)
|
4 bulan lalu |
Eric Curtin
|
408ff524b4
Implement --log-colors with always/never/auto (#15792)
|
4 bulan lalu |
Eric Curtin
|
badb80cadb
Document the new max GPU layers default in help (#15771)
|
4 bulan lalu |
Johannes Gäßler
|
c466abe158
llama: -fa 1/0/-1 aliases for -fa on/off/auto (#15746)
|
4 bulan lalu |
Georgi Gerganov
|
0d161f021a
server : enable /slots by default and make it secure (#15630)
|
4 bulan lalu |
Johannes Gäßler
|
e81b8e4b7f
llama: use FA + max. GPU layers by default (#15434)
|
4 bulan lalu |
Sigbjørn Skjæret
|
84ab83cc0b
model : jina-embeddings-v3 support (#13693)
|
4 bulan lalu |
Georgi Gerganov
|
da54f9f1a2
presets : add qwen3-30B-a3b FIM (#15616)
|
4 bulan lalu |
Daniel Bevenius
|
fcca2182a1
common : add -m to bash completion for --model [no ci] (#15591)
|
4 bulan lalu |
Georgi Gerganov
|
9ebebef62f
llama : remove KV cache defragmentation logic (#15473)
|
4 bulan lalu |
Diego Devesa
|
54a241f505
sched : fix possible use of wrong ids tensor when offloading moe prompt processing (#15488)
|
4 bulan lalu |
Jie Fu (傅杰)
|
ec5ab1a36c
common : fix context shift help message (#15448)
|
4 bulan lalu |
Gian-Carlo Pascutto
|
1e19f5d462
common : Add top-nsigma sampler to help globally (#15428)
|
5 bulan lalu |
Georgi Gerganov
|
d2fcd91cf9
server : disable context shift by default (#15416)
|
5 bulan lalu |
Georgi Gerganov
|
d32e03f449
server : add SWA checkpoints (#15293)
|
5 bulan lalu |
Jonathan Graehl
|
5cdb27e091
finetune: SGD optimizer, more CLI args (#13873)
|
5 bulan lalu |