 Georgi Gerganov
|
afa8a9ec9b
llama : add `llama_vocab`, functions -> methods, naming (#11110)
|
hai 1 ano |
|
Georgi Gerganov
|
47182dd03f
llama : update llama_model API names (#11063)
|
hai 1 ano |
 Xuan Son Nguyen
|
cda0e4b648
llama : remove all_pos_0, all_pos_1, all_seq_id from llama_batch (#9745)
|
hai 1 ano |
 Diego Devesa
|
7eee341bee
common : use common_ prefix for common library functions (#9805)
|
hai 1 ano |
|
Georgi Gerganov
|
6262d13e0b
common : reimplement logging (#9418)
|
hai 1 ano |
|
Georgi Gerganov
|
0abc6a2c25
llama : llama_perf + option to disable timings during decode (#9355)
|
hai 1 ano |
|
Georgi Gerganov
|
d2b496bff4
batched-bench : remove unused code (#9305)
|
hai 1 ano |
|
Xuan Son Nguyen
|
bfe76d4a17
common : move arg parser code to `arg.cpp` (#9388)
|
hai 1 ano |
|
Xuan Son Nguyen
|
1b9ae5189c
common : refactor arg parser (#9308)
|
hai 1 ano |
|
Georgi Gerganov
|
df270ef745
llama : refactor sampling v2 (#9294)
|
hai 1 ano |
 Aarni Koskela
|
815b1fb20a
batched-bench : add `--output-format jsonl` option (#9293)
|
hai 1 ano |
 Brian Cunnie
|
ecf6b7f23e
batched-bench : handle empty `-npl` (#8839)
|
hai 1 ano |
|
Georgi Gerganov
|
1442677f92
common : refactor cli arg parsing (#7675)
|
hai 1 ano |
|
Georgi Gerganov
|
9c67c2773d
ggml : add Flash Attention (#5021)
|
hai 1 ano |
 Ting Sun
|
87e21bbacd
bench : make n_batch and n_ubatch configurable in Batched bench (#6500)
|
hai 1 ano |
|
slaren
|
f30ea47a87
llama : add pipeline parallelism support (#6017)
|
hai 1 ano |
|
Georgi Gerganov
|
05b06210c9
llama : more consistent names of count variables (#5994)
|
hai 1 ano |
 compilade
|
c2101a2e90
llama : support Mamba Selective State Space Models (#5328)
|
hai 1 ano |
 Pierrick Hymbert
|
3ab8b3a92e
llama : cleanup unused mmq flags (#5772)
|
hai 1 ano |
 Herman Semenov
|
5d3de51f97
ggml, common, examples, tests : fixed type arguments in printf (#5528)
|
hai 1 ano |
 bmwl
|
f486f6e1e5
ggml : add numa options (#5377)
|
hai 1 ano |
|
Georgi Gerganov
|
5cb04dbc16
llama : remove LLAMA_MAX_DEVICES and LLAMA_SUPPORTS_GPU_OFFLOAD (#5240)
|
hai 1 ano |
|
slaren
|
e7e4df031b
llama : ggml-backend integration (#4766)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
ef47ec18da
ggml : add ggml_soft_max_ext (#4256)
|
%!s(int64=2) %!d(string=hai) anos |
 Kerfuffle
|
6e08281e58
Extend llama_kv_cache_seq_rm to allow matching any sequence (#3843)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
6961c4bd0b
batched-bench : print params at start
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
0e89203b51
speculative : add tree-based sampling example (#3624)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
8c70a5ff25
batched : add bench tool (#3545)
|
%!s(int64=2) %!d(string=hai) anos |
