 Georgi Gerganov
|
225e7a1438
llama : add high-throughput mode (#14363)
|
пре 6 месеци |
 Aman Gupta
|
ab14019821
Support diffusion models: Add Dream 7B (#14644)
|
пре 6 месеци |
|
Georgi Gerganov
|
6ffd4e9c44
server : pre-calculate EOG logit biases (#14721)
|
пре 6 месеци |
 Alawode Oluwandabira
|
17a1f0d2d4
server: Add ability to mount server at prefix (#14544)
|
пре 6 месеци |
 matteo
|
caf5681fcb
server : support jinja extra template kwargs (Qwen3 enable_thinking feature), from command line and from client (#13196)
|
пре 6 месеци |
 Sigbjørn Skjæret
|
88fc854b4b
llama : improve sep token handling (#14272)
|
пре 7 месеци |
 aa956
|
d67341dc18
server : add server parameters for draft model cache type (#13782)
|
пре 7 месеци |
|
Georgi Gerganov
|
d3e64b9f49
llama : rework embeddings logic (#14208)
|
пре 7 месеци |
 Olivier Chafik
|
c9bbc77931
`server`: update deepseek reasoning format (pass reasoning_content as diffs) (#13933)
|
пре 7 месеци |
|
Olivier Chafik
|
cdf94a1802
server: --offline mode (#13804)
|
пре 7 месеци |
|
Olivier Chafik
|
e121edc432
`server`: add `--reasoning-budget 0` to disable thinking (incl. qwen3 w/ enable_thinking:false) (#13771)
|
пре 8 месеци |
|
Olivier Chafik
|
f5cd27b71d
`server`: streaming of tool calls and thoughts when `--jinja` is on (#12379)
|
пре 8 месеци |
 Xuan-Son Nguyen
|
797990c4bc
mtmd : add ultravox audio input (#13623)
|
пре 8 месеци |
|
Georgi Gerganov
|
a4090d1174
llama : remove llama_kv_cache_view API + remove deprecated (#13653)
|
пре 8 месеци |
|
Georgi Gerganov
|
e298d2fbd0
kv-cache : add SWA support (#13194)
|
пре 8 месеци |
 psocolovsky
|
1dfbf2cf3a
common : add load_progress_callback (#13617)
|
пре 8 месеци |
 Isaac McFadyen
|
6a2bc8bfb7
server : added --no-prefill-assistant flag (#13608)
|
пре 8 месеци |
 Olivier Chafik
|
3198405e98
`common`: add partial regex support (#12808)
|
пре 8 месеци |
 Johannes Gäßler
|
10d2af0eaa
llama/ggml: add LLM training support (#10544)
|
пре 8 месеци |
 David Huang
|
7f323a589f
Add `--no-op-offload` to improve `-ot` pp perf in MoE models like llama4 400B (#13386)
|
пре 8 месеци |
 Bartowski
|
efb8b47eda
imatrix : Add --parse-special for enabling parsing of special tokens in imatrix calculation (#13389)
|
пре 8 месеци |
|
Georgi Gerganov
|
51fb96b1ff
context : remove logits_all flag (#13284)
|
пре 8 месеци |
|
Georgi Gerganov
|
4773d7a02f
examples : remove infill (#13283)
|
пре 8 месеци |
 oobabooga
|
233461f812
sampling : Integrate Top-nσ into main sampling chain (and add it to the server) (#13264)
|
пре 8 месеци |
|
Xuan-Son Nguyen
|
9b61acf060
mtmd : rename llava directory to mtmd (#13311)
|
пре 8 месеци |
 Diego Devesa
|
1d36b3670b
llama : move end-user examples to tools directory (#13249)
|
пре 8 месеци |
|
Xuan-Son Nguyen
|
7c727fbe39
arg : add --no-mmproj-offload (#13093)
|
пре 9 месеци |
|
Xuan-Son Nguyen
|
80982e815e
arg : clean up handling --mmproj with -hf (#13082)
|
пре 9 месеци |
 tastelikefeet
|
b2034c2b55
contrib: support modelscope community (#12664)
|
пре 9 месеци |
|
Diego Devesa
|
e0e912f49b
llama : add option to override model tensor buffers (#11397)
|
пре 9 месеци |
