 Richard Kiss
|
9494d7c477
english : use `typos` to fix comments and logs (#4354)
|
%!s(int64=2) %!d(string=hai) anos |
 stduhpf
|
da5eaef1f3
speculative : support `--color` (#4343)
|
%!s(int64=2) %!d(string=hai) anos |
 Branden Butler
|
40a34fe8d0
speculative : fix prompt tokenization in speculative example (#4025)
|
%!s(int64=2) %!d(string=hai) anos |
 Georgi Gerganov
|
8f961abdc4
speculative : change default p_accept to 0.5 + CLI args (#3919)
|
%!s(int64=2) %!d(string=hai) anos |
 cebtenzzre
|
b12fa0d1c1
build : link against build info instead of compiling against it (#3879)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
ee1a0ec9cb
llama : add option for greedy sampling with probs (#3813)
|
%!s(int64=2) %!d(string=hai) anos |
 Kerfuffle
|
41aee4df82
speculative : ensure draft and target model vocab matches (#3812)
|
%!s(int64=2) %!d(string=hai) anos |
 Marcus Dunn
|
5be6c803fa
llama : remove token functions with `context` args in favor of `model` (#3720)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
d1031cf49c
sampling : refactor init to use llama_sampling_params (#3696)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
4e82b2ea3f
speculative : bug fixes
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
0e89203b51
speculative : add tree-based sampling example (#3624)
|
%!s(int64=2) %!d(string=hai) anos |
|
Kerfuffle
|
70c29da118
common : fix mirostat state when using multiple sequences (#3543)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
ac2219fef3
llama : fix session saving/loading (#3400)
|
%!s(int64=2) %!d(string=hai) anos |
 slaren
|
16bc66d947
llama.cpp : split llama_context_params into model and context params (#3301)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
ec893798b7
llama : custom attention mask + parallel decoding + no context swaps (#3228)
|
%!s(int64=2) %!d(string=hai) anos |
 Leng Yue
|
35f73049af
speculative : add heuristic algorithm (#3006)
|
%!s(int64=2) %!d(string=hai) anos |
 FK
|
84e723653c
speculative: add --n-gpu-layers-draft option (#3063)
|
%!s(int64=2) %!d(string=hai) anos |
 Przemysław Pawełczyk
|
cb6c44c5e0
build : do not use _GNU_SOURCE gratuitously (#2035)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
921772104b
speculative : add grammar support (#2991)
|
%!s(int64=2) %!d(string=hai) anos |
|
Georgi Gerganov
|
47068e5170
speculative : PoC for speeding-up inference via speculative sampling (#2926)
|
%!s(int64=2) %!d(string=hai) anos |
