Commit History

Autor SHA1 Mensaxe Data
  Johannes Gäßler 28103f4832 Server: fix seed for multiple slots (#6835) hai 1 ano
  Rick G e3c337d87c llama : support negative ith in llama_get_ API (#6519) hai 1 ano
  Minsoo Cheong 586e7bc561 sampling : deduplicated code for probability distribution access (#6240) hai 1 ano
  Georgi Gerganov b80cf3b2d1 common : disable repeat penalties by default (#6127) hai 1 ano
  Minsoo Cheong 6d341ab6c5 speculative : implement stochastic speculative sampling (#5625) hai 1 ano
  Robey Holderith 5ee99c32f5 common, server : surface min_keep as its own parameter (#5567) hai 1 ano
  Alexey Parfenov 6dcc02d244 server : add "samplers" param to control the samplers order (#5494) hai 1 ano
  Alexey Parfenov a803333a4e common : use enums for sampler types (#5418) hai 1 ano
  l3utterfly 5eaf9964fc llama : dynamic temperature sampling (#4972) %!s(int64=2) %!d(string=hai) anos
  David Renshaw f46c0c1b0e llama : fix copy/paste error in llama_sampling_params comment (#4994) %!s(int64=2) %!d(string=hai) anos
  Alexey Parfenov 6123979952 server : allow to specify custom prompt for penalty calculation (#3727) %!s(int64=2) %!d(string=hai) anos
  MaggotHATE 52c8bc3cf3 sampling : custom samplers order (#4285) %!s(int64=2) %!d(string=hai) anos
  kalomaze 238657db23 samplers : Min-P sampler implementation [alternative to Top P/Top K] (#3841) %!s(int64=2) %!d(string=hai) anos
  Georgi Gerganov d1031cf49c sampling : refactor init to use llama_sampling_params (#3696) %!s(int64=2) %!d(string=hai) anos
  Georgi Gerganov 0e89203b51 speculative : add tree-based sampling example (#3624) %!s(int64=2) %!d(string=hai) anos
  Kerfuffle 70c29da118 common : fix mirostat state when using multiple sequences (#3543) %!s(int64=2) %!d(string=hai) anos