 kallewoof
|
810b9fc8b9
perplexity : provide a helpful hint for has_cpl case in split_equal error. (#15304)
|
5 mesi fa |
 Georgi Gerganov
|
00131d6eaf
tests : update for LLAMA_SET_ROWS=1 (#14961)
|
5 mesi fa |
|
Georgi Gerganov
|
01612b7409
llama : reuse compute graphs (#14482)
|
6 mesi fa |
|
Georgi Gerganov
|
ad57d3edd2
batch : fix uninitialized has_cpl flag (#14733)
|
6 mesi fa |
|
Georgi Gerganov
|
225e7a1438
llama : add high-throughput mode (#14363)
|
6 mesi fa |
|
Georgi Gerganov
|
67d1ef23c6
batch : add optional for sequential equal split (#14511)
|
6 mesi fa |
|
Georgi Gerganov
|
c79184d2d1
batch : add n_used count (#14512)
|
6 mesi fa |
|
Georgi Gerganov
|
62af464227
batch : fix check for empty sequences in memory (#14364)
|
6 mesi fa |
|
Georgi Gerganov
|
7b50d589a8
kv-cells : fix tracking of seq_pos (#14339)
|
6 mesi fa |
|
Georgi Gerganov
|
4c9fdfbe15
ubatch : new splitting logic (#14217)
|
7 mesi fa |
|
Georgi Gerganov
|
d3e64b9f49
llama : rework embeddings logic (#14208)
|
7 mesi fa |
|
Georgi Gerganov
|
c311ac664d
cparams : rename LLAMA_MAX_PARALLEL_SEQUENCES to LLAMA_MAX_SEQ (#14188)
|
7 mesi fa |
|
Georgi Gerganov
|
b9912ac570
batch : auto-gen positions + verify multi-sequence input (#14177)
|
7 mesi fa |
|
Georgi Gerganov
|
80709b70a2
batch : add LLAMA_BATCH_DEBUG environment variable (#14172)
|
7 mesi fa |
|
Georgi Gerganov
|
60c666347b
batch : rework llama_batch_allocr (#14153)
|
7 mesi fa |
|
Georgi Gerganov
|
f6e1a7aa87
context : simplify output counting logic during decode (#14142)
|
7 mesi fa |
|
Georgi Gerganov
|
c3ee46fab4
batch : remove logits_all flag (#14141)
|
7 mesi fa |
|
Georgi Gerganov
|
12d0188c0d
kv-cache : refactor + add llama_memory_state_i (#13746)
|
7 mesi fa |
|
Georgi Gerganov
|
797f2ac062
kv-cache : simplify the interface (#13660)
|
8 mesi fa |
|
Georgi Gerganov
|
c642bc014c
kv-cache : separate recurrent vs non-recurrent impl (#12799)
|
8 mesi fa |
|
Georgi Gerganov
|
f66f582927
llama : refactor `src/llama.cpp` (#10902)
|
1 anno fa |
