 Georgi Gerganov
|
39173bcacb
context : reserve new scheduler when graph topology changes (#18547)
|
hace 2 semanas |
 Johannes Gäßler
|
64848deb18
llama-fit-params: free memory target per device (#18679)
|
hace 3 semanas |
 Julius Tischbein
|
2038101bd9
llama : add `use_direct_io` flag for model loading (#18166)
|
hace 3 semanas |
 Daniel Bevenius
|
d3dce4e0a5
sampling : add support for backend sampling (#17004)
|
hace 3 semanas |
 Xuan-Son Nguyen
|
cd78e57c3a
lora: count lora nodes in graph_max_nodes (#18469)
|
hace 1 mes |
 o7si
|
daa242dfc8
common: fix return value check for setpriority (#18412)
|
hace 1 mes |
|
Johannes Gäßler
|
026d2ad472
llama: fix magic number of 999 for GPU layers (#18266)
|
hace 1 mes |
|
Johannes Gäßler
|
147a521636
tool/ex/tests: consistently free ctx, then model (#18168)
|
hace 1 mes |
|
Johannes Gäßler
|
a2c199e479
common: clarify instructions for bug reports (#18134)
|
hace 1 mes |
|
Johannes Gäßler
|
b1f3a6e5db
llama: automatically set parameters not set by the user in such a way that maximizes GPU utilization (#16653)
|
hace 1 mes |
|
Georgi Gerganov
|
254098a279
common : refactor common_sampler + grammar logic changes (#17937)
|
hace 1 mes |
 Sigbjørn Skjæret
|
22577583a3
common : change --color to accept on/off/auto, default to auto (#17827)
|
hace 1 mes |
 Adrien Gallouët
|
83c1171529
common: use native MultiByteToWideChar (#17738)
|
hace 1 mes |
 Reese Levine
|
7ca5991d2b
ggml webgpu: add support for emscripten builds (#17184)
|
hace 1 mes |
|
Xuan-Son Nguyen
|
13628d8bdb
server: add --media-path for local media files (#17697)
|
hace 1 mes |
|
Xuan-Son Nguyen
|
ec18edfcba
server: introduce API for serving / loading / unloading multiple models (#17470)
|
hace 1 mes |
 Aaron Teo
|
877566d512
llama: introduce support for model-embedded sampling parameters (#17120)
|
hace 2 meses |
|
Georgi Gerganov
|
196f5083ef
common : more accurate sampling timing (#17382)
|
hace 2 meses |
|
Xuan-Son Nguyen
|
9b17d74ab7
mtmd: add mtmd_log_set (#17268)
|
hace 2 meses |
|
Xuan-Son Nguyen
|
aa3b7a90b4
arg: add --cache-list argument to list cached models (#17073)
|
hace 2 meses |
 Gadflyii
|
3df2244df4
llama : add --no-host to disable host buffers (#16310)
|
hace 3 meses |
|
Aaron Teo
|
624207e676
devops: add s390x & ppc64le CI (#15925)
|
hace 4 meses |
 Douglas Hanley
|
b5bd037832
llama : add support for qwen3 reranker (#15824)
|
hace 4 meses |
 Uilian Ries
|
152729f884
common : add missing chrono header for common.cpp (#16211)
|
hace 4 meses |
|
Johannes Gäßler
|
e81b8e4b7f
llama: use FA + max. GPU layers by default (#15434)
|
hace 5 meses |
|
Sigbjørn Skjæret
|
84ab83cc0b
model : jina-embeddings-v3 support (#13693)
|
hace 5 meses |
|
Georgi Gerganov
|
9ebebef62f
llama : remove KV cache defragmentation logic (#15473)
|
hace 5 meses |
 Jie Fu (傅杰)
|
2f3dbffb17
common : fix incorrect print of non-ascii characters in the logging (#15466)
|
hace 5 meses |
 Jonathan Graehl
|
5cdb27e091
finetune: SGD optimizer, more CLI args (#13873)
|
hace 5 meses |
 Diego Devesa
|
d6818d06a6
llama : allow other bufts when overriding to CPU, add --no-repack option (#14990)
|
hace 6 meses |
