 Georgi Gerganov
|
228f724d9c
kv-cache : fix seq_rm with seq_id == -1 (#15226)
|
il y a 5 mois |
 Daniel Bevenius
|
cd3069dfcb
kv-cache : log (debug) all streams in find_slot (#15176)
|
il y a 5 mois |
 Sam
|
ef0144c087
model: support GLM 4.5 family of models (#14939)
|
il y a 5 mois |
|
Daniel Bevenius
|
4fdea540bd
kv-cache : skip alignment of n_stream in kv-cache log msg [no ci] (#15040)
|
il y a 5 mois |
|
Georgi Gerganov
|
a4569c41fd
llama : enable LLAMA_SET_ROWS=1 by default (#14959)
|
il y a 5 mois |
|
Georgi Gerganov
|
d6fb3f6b49
kv-cache : fix k-shift for multiple streams (#14742)
|
il y a 6 mois |
|
Georgi Gerganov
|
01612b7409
llama : reuse compute graphs (#14482)
|
il y a 6 mois |
|
Georgi Gerganov
|
d9b691081c
kv-cache : opt mask set input (#14600)
|
il y a 6 mois |
|
Georgi Gerganov
|
225e7a1438
llama : add high-throughput mode (#14363)
|
il y a 6 mois |
|
Georgi Gerganov
|
c79184d2d1
batch : add n_used count (#14512)
|
il y a 6 mois |
|
Georgi Gerganov
|
a70c8a0c4b
kv-cache : use ggml_set_rows (#14285)
|
il y a 6 mois |
|
Georgi Gerganov
|
745f11fed0
memory : correctly handle failure in apply() (#14438)
|
il y a 6 mois |
 Xuan-Son Nguyen
|
8846aace49
model : gemma3n text-only (#14400)
|
il y a 7 mois |
|
Georgi Gerganov
|
692e3cdd0a
memory : rename interface to llama_memory_context_i (#14296)
|
il y a 7 mois |
|
Georgi Gerganov
|
4c9fdfbe15
ubatch : new splitting logic (#14217)
|
il y a 7 mois |
 Gabe Goodhart
|
edc4a29eff
memory : Hybrid recurrent cache (#13979)
|
il y a 7 mois |
|
Georgi Gerganov
|
d3e64b9f49
llama : rework embeddings logic (#14208)
|
il y a 7 mois |
|
Georgi Gerganov
|
5fce5f948d
kv-cache : fix use-after-move of defrag info (#14189)
|
il y a 7 mois |
|
Georgi Gerganov
|
c311ac664d
cparams : rename LLAMA_MAX_PARALLEL_SEQUENCES to LLAMA_MAX_SEQ (#14188)
|
il y a 7 mois |
|
Georgi Gerganov
|
60c666347b
batch : rework llama_batch_allocr (#14153)
|
il y a 7 mois |
|
Georgi Gerganov
|
c3ee46fab4
batch : remove logits_all flag (#14141)
|
il y a 7 mois |
|
Georgi Gerganov
|
9596506965
kv-cache : fix split_equal handling in unified implementation (#14130)
|
il y a 7 mois |
|
Georgi Gerganov
|
89a184fa71
kv-cache : relax SWA masking condition (#14119)
|
il y a 7 mois |
|
Georgi Gerganov
|
7ae2932116
kv-cache : add LLAMA_KV_CACHE_DEBUG environment variable (#14121)
|
il y a 7 mois |
 compilade
|
dad5c44398
kv-cache : avoid modifying recurrent cells when setting inputs (#13834)
|
il y a 7 mois |
|
Georgi Gerganov
|
40cbf571c9
kv-cache : fix shift and defrag logic (#14081)
|
il y a 7 mois |
|
Georgi Gerganov
|
745aa5319b
llama : deprecate llama_kv_self_ API (#14030)
|
il y a 7 mois |
|
Georgi Gerganov
|
3e63a58ef7
kv-cache : refactor the update/defrag mechanism (#13988)
|
il y a 7 mois |
|
Georgi Gerganov
|
e0e806f52e
kv-cache : fix unified::seq_rm to work with seq_id < 0 (#13985)
|
il y a 7 mois |
|
Georgi Gerganov
|
0fc16b42e8
kv-cache : split implementation in separate sources (#13920)
|
il y a 7 mois |
