 Georgi Gerganov
|
e298d2fbd0
kv-cache : add SWA support (#13194)
|
hai 8 meses |
 Diego Devesa
|
6c8b91500e
llama-bench : fix -ot with dl backends (#13563)
|
hai 8 meses |
|
Georgi Gerganov
|
b2838049cc
bench : handle decode errors (#13548)
|
hai 8 meses |
|
Diego Devesa
|
cf0a43bb64
llama-bench : add defrag-thold, check for invalid ranges (#13487)
|
hai 8 meses |
|
Diego Devesa
|
22cdab343b
llama-bench : accept ranges for integer parameters (#13410)
|
hai 8 meses |
 David Huang
|
7f323a589f
Add `--no-op-offload` to improve `-ot` pp perf in MoE models like llama4 400B (#13386)
|
hai 8 meses |
|
Diego Devesa
|
1d36b3670b
llama : move end-user examples to tools directory (#13249)
|
hai 8 meses |
