 Georgi Gerganov
|
6562e5a4d6
context : allow cache-less context for embeddings (#13108)
|
il y a 8 mois |
|
Georgi Gerganov
|
51fb96b1ff
context : remove logits_all flag (#13284)
|
il y a 8 mois |
|
Georgi Gerganov
|
a75cb30dc9
context : fix reorder logic (#13267)
|
il y a 8 mois |
|
Georgi Gerganov
|
c642bc014c
kv-cache : separate recurrent vs non-recurrent impl (#12799)
|
il y a 8 mois |
 ddh0
|
16a457facd
fix typo: `n_ctx_pre_seq` -> `n_ctx_per_seq` (#13221)
|
il y a 8 mois |
 pockers21
|
fb0471d175
context : do not clear output buffer on reserve (#13152)
|
il y a 8 mois |
 Diego Devesa
|
295354ea68
llama : fix K-shift with quantized K and BLAS backend (#13113)
|
il y a 8 mois |
|
Georgi Gerganov
|
2f74c354c0
graph : make FA compatible with MLA + add initial Metal kernels (#12953)
|
il y a 9 mois |
 Juk Armstrong
|
daa422881a
llama : DeepSeek V2/V3 MLA implementation (#12801)
|
il y a 9 mois |
|
Georgi Gerganov
|
3e1d29348b
kv-cache : simplify + fix warning for recurrent models (#12756)
|
il y a 9 mois |
|
Diego Devesa
|
e0e912f49b
llama : add option to override model tensor buffers (#11397)
|
il y a 9 mois |
|
Georgi Gerganov
|
a10b36c91a
llama : refactor kv cache guard (#12695)
|
il y a 9 mois |
 Xuan-Son Nguyen
|
af6ae1efb2
llama : fix non-causal mask for gemma 3 (#12615)
|
il y a 9 mois |
|
Georgi Gerganov
|
b4ae50810e
metal : improve FA + improve MoE (#12612)
|
il y a 9 mois |
|
Georgi Gerganov
|
2d77d88e70
context : fix worst-case reserve outputs (#12545)
|
il y a 9 mois |
 fairydreaming
|
568013d0cd
context : clear sets containing encoder output sequence ids before storing new values (#12470)
|
il y a 10 mois |
|
Georgi Gerganov
|
75422e8bc4
graph : normalize Q, K, V shapes + sync cross attention (#12449)
|
il y a 10 mois |
|
Georgi Gerganov
|
8551c44d84
context : always use non-causal attention for encoder graphs (#12447)
|
il y a 10 mois |
|
Georgi Gerganov
|
dc079cfdff
context : fix init of n_outputs (#12397)
|
il y a 10 mois |
|
fairydreaming
|
8fcb563613
Load all MoE experts during warmup (#11571)
|
il y a 10 mois |
|
Georgi Gerganov
|
081bee8c64
hparams : add SWA rope parameters (#12374)
|
il y a 10 mois |
|
Georgi Gerganov
|
84d5475541
llama : fix Gemma3 SWA KV cache shift (#12373)
|
il y a 10 mois |
|
Georgi Gerganov
|
e0dbec0bc6
llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)
|
il y a 10 mois |
|
Georgi Gerganov
|
afa8a9ec9b
llama : add `llama_vocab`, functions -> methods, naming (#11110)
|
il y a 1 an |
|
Georgi Gerganov
|
f66f582927
llama : refactor `src/llama.cpp` (#10902)
|
il y a 1 an |
