 JJJYmmm
|
d261223d24
model: add support for qwen3vl series (#16780)
|
2 months ago |
 Xuan-Son Nguyen
|
e3af5563bd
llama: store mrope data in KV cell (#16825)
|
2 months ago |
 Georgi Gerganov
|
85a7d8677b
memory : remove KV cache size padding (#16812)
|
2 months ago |
 Johannes Gäßler
|
7a0e900e36
llama: consistent ctx <-> buf order for KV cache (#16746)
|
2 months ago |
|
Georgi Gerganov
|
d00cbea63c
server : host-memory prompt caching (#16391)
|
3 months ago |
|
Johannes Gäßler
|
e789095502
llama: print memory breakdown on exit (#15860)
|
3 months ago |
|
Georgi Gerganov
|
cf0e3ba150
model : avoid ggml_cont_3d for fused QKV weights (#15662)
|
4 months ago |
|
Georgi Gerganov
|
c610b6c11b
kv-cache : fix SWA checks + disable cacheless iSWA (#15811)
|
4 months ago |
 Daniel Bevenius
|
fb15d649ed
llama : add support for EmbeddingGemma 300m (#15798)
|
4 months ago |
|
Georgi Gerganov
|
c8d0d14e77
kv-cache : fix find_slot to not search for continuous slot (#15638)
|
4 months ago |
|
Georgi Gerganov
|
8a4280ce43
kv-cache : remove LLAMA_SET_ROWS checks (#15505)
|
4 months ago |
|
Georgi Gerganov
|
1bded5a3b3
kv-cache : better estimate of n_kv for multi-sequence batches (#15610)
|
4 months ago |
|
Georgi Gerganov
|
b730706a49
kv-cache : support layer reuse (#15504)
|
4 months ago |
|
Georgi Gerganov
|
9ebebef62f
llama : remove KV cache defragmentation logic (#15473)
|
5 months ago |
|
Georgi Gerganov
|
715a6db02c
kv-cache : drop the "unified" prefix (#15467)
|
5 months ago |
|
Georgi Gerganov
|
7f37b6cf1e
memory : migrate from llama_kv_cache to more generic llama_memory (#14006)
|
7 months ago |
|
Georgi Gerganov
|
0fc16b42e8
kv-cache : split implementation in separate sources (#13920)
|
7 months ago |
|
Georgi Gerganov
|
3600cc2886
llama : use n_swa + n_ubatch cells for SWA cache (#13833)
|
7 months ago |
|
Georgi Gerganov
|
3f55f781f1
llama : auto-batch preparation (#13845)
|
7 months ago |
|
Georgi Gerganov
|
12d0188c0d
kv-cache : refactor + add llama_memory_state_i (#13746)
|
7 months ago |
|
Xuan-Son Nguyen
|
763d06edb7
llama : fix KV shift for qwen2vl (#13870)
|
7 months ago |
|
Georgi Gerganov
|
81713121ee
kv-cells : track min/max used cells and per-sequence positions (#13808)
|
7 months ago |
|
Georgi Gerganov
|
de2ef53a4b
kv-cache : rework kv_cell (#13706)
|
8 months ago |
|
Georgi Gerganov
|
797f2ac062
kv-cache : simplify the interface (#13660)
|
8 months ago |
|
Georgi Gerganov
|
a4090d1174
llama : remove llama_kv_cache_view API + remove deprecated (#13653)
|
8 months ago |
|
Georgi Gerganov
|
e298d2fbd0
kv-cache : add SWA support (#13194)
|
8 months ago |
|
Georgi Gerganov
|
e3a9421b78
kv-cache : fix out-of-bounds view during reserve graph (#13547)
|
8 months ago |
|
Georgi Gerganov
|
c642bc014c
kv-cache : separate recurrent vs non-recurrent impl (#12799)
|
8 months ago |
 Juk Armstrong
|
daa422881a
llama : DeepSeek V2/V3 MLA implementation (#12801)
|
9 months ago |
|
Georgi Gerganov
|
3e1d29348b
kv-cache : simplify + fix warning for recurrent models (#12756)
|
9 months ago |
