 Pascal
|
6ce3d85796
server: (webui) add --webui-config (#18028)
|
hace 1 mes |
 Johannes Gäßler
|
b1f3a6e5db
llama: automatically set parameters not set by the user in such a way that maximizes GPU utilization (#16653)
|
hace 1 mes |
 Georgi Gerganov
|
254098a279
common : refactor common_sampler + grammar logic changes (#17937)
|
hace 1 mes |
 Xuan-Son Nguyen
|
34a6d86982
cli: enable jinja by default (#17911)
|
hace 1 mes |
|
Pascal
|
f32ca51bfe
server: add presets (config) when using multiple models (#17859)
|
hace 1 mes |
|
Xuan-Son Nguyen
|
6c2131773c
cli: new CLI experience (#17824)
|
hace 1 mes |
 Sigbjørn Skjæret
|
22577583a3
common : change --color to accept on/off/auto, default to auto (#17827)
|
hace 1 mes |
 Adrien Gallouët
|
ef75a89fdb
build : move _WIN32_WINNT definition to headers (#17736)
|
hace 1 mes |
|
Xuan-Son Nguyen
|
13628d8bdb
server: add --media-path for local media files (#17697)
|
hace 1 mes |
|
Xuan-Son Nguyen
|
ec18edfcba
server: introduce API for serving / loading / unloading multiple models (#17470)
|
hace 1 mes |
|
Xuan-Son Nguyen
|
7733409734
common: improve verbosity level definitions (#17630)
|
hace 1 mes |
 Aaron Teo
|
877566d512
llama: introduce support for model-embedded sampling parameters (#17120)
|
hace 1 mes |
|
Georgi Gerganov
|
196f5083ef
common : more accurate sampling timing (#17382)
|
hace 1 mes |
|
Georgi Gerganov
|
f914544b16
batched-bench : add "separate text gen" mode (#17103)
|
hace 2 meses |
|
Xuan-Son Nguyen
|
aa3b7a90b4
arg: add --cache-list argument to list cached models (#17073)
|
hace 2 meses |
|
Georgi Gerganov
|
13b339bcd9
server : do not default to multiple slots with speculative decoding (#17017)
|
hace 2 meses |
|
Xuan-Son Nguyen
|
070ff4d535
mtmd: add --image-min/max-tokens (#16921)
|
hace 2 meses |
|
Georgi Gerganov
|
4b2dae383d
common : update presets (#16504)
|
hace 3 meses |
|
Georgi Gerganov
|
d00cbea63c
server : host-memory prompt caching (#16391)
|
hace 3 meses |
|
Pascal
|
12bbc3fa50
refactor: centralize CoT parsing in backend for streaming mode (#16394)
|
hace 3 meses |
 Gadflyii
|
3df2244df4
llama : add --no-host to disable host buffers (#16310)
|
hace 3 meses |
 ddh0
|
f6dcda3900
server : context checkpointing for hybrid and recurrent models (#16382)
|
hace 3 meses |
|
Sigbjørn Skjæret
|
835b2b915c
model : add GroveMoE support (#15510)
|
hace 3 meses |
 jacekpoplawski
|
8ff206097c
llama-bench: add --n-cpu-moe support (#15952)
|
hace 4 meses |
|
Sigbjørn Skjæret
|
b8e09f08b9
model : add grok-2 support (#15539)
|
hace 4 meses |
 Eric Curtin
|
4bf5549269
Add docker protocol support for llama-server model loading (#15790)
|
hace 4 meses |
|
Georgi Gerganov
|
f088b6a84f
server : adjust prompt similarity thold + add logs (#15913)
|
hace 4 meses |
|
Georgi Gerganov
|
0d161f021a
server : enable /slots by default and make it secure (#15630)
|
hace 4 meses |
|
Johannes Gäßler
|
e81b8e4b7f
llama: use FA + max. GPU layers by default (#15434)
|
hace 4 meses |
|
Sigbjørn Skjæret
|
84ab83cc0b
model : jina-embeddings-v3 support (#13693)
|
hace 4 meses |
