 Johannes Gäßler
|
af0a5b6163
server: fix incorrectly reported token probabilities (#7125)
|
vor 1 Jahr |
|
Johannes Gäßler
|
28103f4832
Server: fix seed for multiple slots (#6835)
|
vor 1 Jahr |
 Rick G
|
e3c337d87c
llama : support negative ith in llama_get_ API (#6519)
|
vor 1 Jahr |
 Minsoo Cheong
|
586e7bc561
sampling : deduplicated code for probability distribution access (#6240)
|
vor 1 Jahr |
 Georgi Gerganov
|
b80cf3b2d1
common : disable repeat penalties by default (#6127)
|
vor 1 Jahr |
|
Minsoo Cheong
|
6d341ab6c5
speculative : implement stochastic speculative sampling (#5625)
|
vor 1 Jahr |
 Robey Holderith
|
5ee99c32f5
common, server : surface min_keep as its own parameter (#5567)
|
vor 1 Jahr |
 Alexey Parfenov
|
6dcc02d244
server : add "samplers" param to control the samplers order (#5494)
|
vor 1 Jahr |
|
Alexey Parfenov
|
a803333a4e
common : use enums for sampler types (#5418)
|
vor 1 Jahr |
 l3utterfly
|
5eaf9964fc
llama : dynamic temperature sampling (#4972)
|
vor 2 Jahren |
 David Renshaw
|
f46c0c1b0e
llama : fix copy/paste error in llama_sampling_params comment (#4994)
|
vor 2 Jahren |
|
Alexey Parfenov
|
6123979952
server : allow to specify custom prompt for penalty calculation (#3727)
|
vor 2 Jahren |
 MaggotHATE
|
52c8bc3cf3
sampling : custom samplers order (#4285)
|
vor 2 Jahren |
 kalomaze
|
238657db23
samplers : Min-P sampler implementation [alternative to Top P/Top K] (#3841)
|
vor 2 Jahren |
|
Georgi Gerganov
|
d1031cf49c
sampling : refactor init to use llama_sampling_params (#3696)
|
vor 2 Jahren |
|
Georgi Gerganov
|
0e89203b51
speculative : add tree-based sampling example (#3624)
|
vor 2 Jahren |
 Kerfuffle
|
70c29da118
common : fix mirostat state when using multiple sequences (#3543)
|
vor 2 Jahren |
