 Georgi Gerganov
|
89a184fa71
kv-cache : relax SWA masking condition (#14119)
|
7 months ago |
|
Georgi Gerganov
|
7ae2932116
kv-cache : add LLAMA_KV_CACHE_DEBUG environment variable (#14121)
|
7 months ago |
 compilade
|
dad5c44398
kv-cache : avoid modifying recurrent cells when setting inputs (#13834)
|
7 months ago |
|
Georgi Gerganov
|
40cbf571c9
kv-cache : fix shift and defrag logic (#14081)
|
7 months ago |
|
Georgi Gerganov
|
745aa5319b
llama : deprecate llama_kv_self_ API (#14030)
|
7 months ago |
|
Georgi Gerganov
|
3e63a58ef7
kv-cache : refactor the update/defrag mechanism (#13988)
|
7 months ago |
|
Georgi Gerganov
|
e0e806f52e
kv-cache : fix unified::seq_rm to work with seq_id < 0 (#13985)
|
7 months ago |
|
Georgi Gerganov
|
0fc16b42e8
kv-cache : split implementation in separate sources (#13920)
|
7 months ago |
