 Georgi Gerganov
|
b0f27361f3
sampling : avoid expensive softmax during greedy sampling (#9605)
|
hai 1 ano |
|
Georgi Gerganov
|
6262d13e0b
common : reimplement logging (#9418)
|
hai 1 ano |
|
Georgi Gerganov
|
0abc6a2c25
llama : llama_perf + option to disable timings during decode (#9355)
|
hai 1 ano |
 Xuan Son Nguyen
|
bfe76d4a17
common : move arg parser code to `arg.cpp` (#9388)
|
hai 1 ano |
|
Xuan Son Nguyen
|
1b9ae5189c
common : refactor arg parser (#9308)
|
hai 1 ano |
|
Georgi Gerganov
|
df270ef745
llama : refactor sampling v2 (#9294)
|
hai 1 ano |
 Faisal Zaghloul
|
42c76d1358
Threadpool: take 2 (#8672)
|
hai 1 ano |
 Liu Jia
|
0a4ce78681
common : Changed tuple to struct (TODO fix) (#8823)
|
hai 1 ano |
|
Georgi Gerganov
|
1442677f92
common : refactor cli arg parsing (#7675)
|
hai 1 ano |
 Pedro Cuenca
|
b97bc3966e
llama : support Llama 3 HF conversion (#6745)
|
hai 1 ano |
 Jared Van Bortel
|
1b67731e18
BERT tokenizer fixes (#6498)
|
hai 1 ano |
 compilade
|
557410b8f0
llama : greatly reduce output buffer memory usage (#6122)
|
hai 1 ano |
 Minsoo Cheong
|
586e7bc561
sampling : deduplicated code for probability distribution access (#6240)
|
hai 1 ano |
 Jeffrey Quesnelle
|
29eee40474
fix speculative decoding build on windows (#5874)
|
hai 1 ano |
|
Minsoo Cheong
|
6d341ab6c5
speculative : implement stochastic speculative sampling (#5625)
|
hai 1 ano |
 bmwl
|
f486f6e1e5
ggml : add numa options (#5377)
|
hai 1 ano |
 stduhpf
|
e0324285a5
speculative : threading options (#4959)
|
%!s(int64=2) %!d(string=hai) anos |
 Richard Kiss
|
9494d7c477
english : use `typos` to fix comments and logs (#4354)
|
%!s(int64=2) %!d(string=hai) anos |
|
stduhpf
|
da5eaef1f3
speculative : support `--color` (#4343)
|
%!s(int64=2) %!d(string=hai) anos |
 Branden Butler
|
40a34fe8d0
speculative : fix prompt tokenization in speculative example (#4025)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
8f961abdc4
speculative : change default p_accept to 0.5 + CLI args (#3919)
|
%!s(int64=2) %!d(string=hai) anos |
 cebtenzzre
|
b12fa0d1c1
build : link against build info instead of compiling against it (#3879)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
ee1a0ec9cb
llama : add option for greedy sampling with probs (#3813)
|
%!s(int64=2) %!d(string=hai) anos |
 Kerfuffle
|
41aee4df82
speculative : ensure draft and target model vocab matches (#3812)
|
%!s(int64=2) %!d(string=hai) anos |
 Marcus Dunn
|
5be6c803fa
llama : remove token functions with `context` args in favor of `model` (#3720)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
d1031cf49c
sampling : refactor init to use llama_sampling_params (#3696)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
4e82b2ea3f
speculative : bug fixes
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
0e89203b51
speculative : add tree-based sampling example (#3624)
|
%!s(int64=2) %!d(string=hai) anos |
|
Kerfuffle
|
70c29da118
common : fix mirostat state when using multiple sequences (#3543)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
ac2219fef3
llama : fix session saving/loading (#3400)
|
%!s(int64=2) %!d(string=hai) anos |
