 Georgi Gerganov
|
d3e64b9f49
llama : rework embeddings logic (#14208)
|
пре 7 месеци |
|
Georgi Gerganov
|
c311ac664d
cparams : rename LLAMA_MAX_PARALLEL_SEQUENCES to LLAMA_MAX_SEQ (#14188)
|
пре 7 месеци |
|
Georgi Gerganov
|
b9912ac570
batch : auto-gen positions + verify multi-sequence input (#14177)
|
пре 7 месеци |
|
Georgi Gerganov
|
60c666347b
batch : rework llama_batch_allocr (#14153)
|
пре 7 месеци |
|
Georgi Gerganov
|
f6e1a7aa87
context : simplify output counting logic during decode (#14142)
|
пре 7 месеци |
|
Georgi Gerganov
|
c3ee46fab4
batch : remove logits_all flag (#14141)
|
пре 7 месеци |
|
Georgi Gerganov
|
9596506965
kv-cache : fix split_equal handling in unified implementation (#14130)
|
пре 7 месеци |
 compilade
|
a20b2b05bc
context : round n_tokens to next multiple of n_seqs when reserving (#14140)
|
пре 7 месеци |
|
Georgi Gerganov
|
745aa5319b
llama : deprecate llama_kv_self_ API (#14030)
|
пре 7 месеци |
|
Georgi Gerganov
|
487a5e0401
context : fix SWA-related warning for multiple sequences (#14045)
|
пре 7 месеци |
 Sigbjørn Skjæret
|
d17a809ef0
llama : support multiple classifier outputs and labels (#13940)
|
пре 7 месеци |
|
Georgi Gerganov
|
7f37b6cf1e
memory : migrate from llama_kv_cache to more generic llama_memory (#14006)
|
пре 7 месеци |
|
Georgi Gerganov
|
9e31bec4fd
context : fix pos_min initialization upon error decode (#14008)
|
пре 7 месеци |
|
Georgi Gerganov
|
3e63a58ef7
kv-cache : refactor the update/defrag mechanism (#13988)
|
пре 7 месеци |
|
Georgi Gerganov
|
803f8baf4f
llama : deprecate explicit kv_self defrag/update calls (#13921)
|
пре 7 месеци |
|
Georgi Gerganov
|
3600cc2886
llama : use n_swa + n_ubatch cells for SWA cache (#13833)
|
пре 7 месеци |
|
Georgi Gerganov
|
3f55f781f1
llama : auto-batch preparation (#13845)
|
пре 7 месеци |
|
Georgi Gerganov
|
12d0188c0d
kv-cache : refactor + add llama_memory_state_i (#13746)
|
пре 7 месеци |
|
Georgi Gerganov
|
4f81b33e32
llama : validate seq id batch input (#13809)
|
пре 7 месеци |
|
Georgi Gerganov
|
79c137f776
examples : allow extracting embeddings from decoder contexts (#13797)
|
пре 7 месеци |
|
Georgi Gerganov
|
de2ef53a4b
kv-cache : rework kv_cell (#13706)
|
пре 7 месеци |
|
Georgi Gerganov
|
797f2ac062
kv-cache : simplify the interface (#13660)
|
пре 8 месеци |
|
Georgi Gerganov
|
a4090d1174
llama : remove llama_kv_cache_view API + remove deprecated (#13653)
|
пре 8 месеци |
|
Georgi Gerganov
|
e298d2fbd0
kv-cache : add SWA support (#13194)
|
пре 8 месеци |
|
Sigbjørn Skjæret
|
f5170c1d7a
editorconfig : fix trailing whitespace from #13542 (#13546)
|
пре 8 месеци |
 Gilad S.
|
017f10b5fa
fix: crash when calling `llama_state_get_size` on a context without a KV cache (#13542)
|
пре 8 месеци |
 Johannes Gäßler
|
10d2af0eaa
llama/ggml: add LLM training support (#10544)
|
пре 8 месеци |
|
Georgi Gerganov
|
064cc596ac
context : fix state io for memory-less contexts (#13470)
|
пре 8 месеци |
 David Huang
|
7f323a589f
Add `--no-op-offload` to improve `-ot` pp perf in MoE models like llama4 400B (#13386)
|
пре 8 месеци |
|
Georgi Gerganov
|
6562e5a4d6
context : allow cache-less context for embeddings (#13108)
|
пре 8 месеци |
