Commit History

Autor SHA1 Mensaxe Data
  Douglas Hanley b4e4b8a935 llama : add llama_get_pooling_type function (#6862) hai 1 ano
  Kyle Mistele 37246b1031 common : revert showing control tokens by default for server (#6860) hai 1 ano
  Justine Tunney 8cc91dc63c ggml : add llamafile sgemm (#6414) hai 1 ano
  Pierrick Hymbert b804b1ef77 eval-callback: Example how to use eval callback for debugging (#6576) hai 1 ano
  Jared Van Bortel 1b67731e18 BERT tokenizer fixes (#6498) hai 1 ano
  Jan Boon beea6e1b16 llama : save and restore kv cache for single seq id (#6341) hai 1 ano
  Minsoo Cheong 64e7b47c69 examples : add "retrieval" (#6193) hai 1 ano
  Pierrick Hymbert f482bb2e49 common: llama_load_model_from_url split support (#6192) hai 1 ano
  Johannes Gäßler 50ccaf5eac lookup: complement data from context with general text statistics (#5479) hai 1 ano
  Georgi Gerganov 80bd33bc2c common : add HF arg helpers (#6234) hai 1 ano
  Georgi Gerganov 68e210b354 server : enable continuous batching by default (#6231) hai 1 ano
  Pierrick Hymbert d01b3c4c32 common: llama_load_model_from_url using --model-url (#6098) hai 1 ano
  Theia Vogel 877b4d0c62 llama : add support for control vectors (#5970) hai 1 ano
  Georgi Gerganov 0fd6c1f015 embedding : print cosine similarity (#899) hai 1 ano
  slaren f30ea47a87 llama : add pipeline parallelism support (#6017) hai 1 ano
  SeungWon Jeong fb215c3832 server : normalize embeddings (#5956) hai 1 ano
  Minsoo Cheong 6d341ab6c5 speculative : implement stochastic speculative sampling (#5625) hai 1 ano
  DAN™ 82f3e668ad common : use LLAMA_DEFAULT_SEED (#5855) hai 1 ano
  Douglas Hanley 475df1d6cf llama : allow for user specified embedding pooling type (#5849) hai 1 ano
  Pierrick Hymbert 3ab8b3a92e llama : cleanup unused mmq flags (#5772) hai 1 ano
  Georgi Gerganov 9d533a77d0 llama : fix defrag bugs + add parameter (#5735) hai 1 ano
  Georgi Gerganov ab336a9d5e code : normalize enum names (#5697) hai 1 ano
  Alexey Parfenov 6dcc02d244 server : add "samplers" param to control the samplers order (#5494) hai 1 ano
  bmwl f486f6e1e5 ggml : add numa options (#5377) hai 1 ano
  Alexey Parfenov a803333a4e common : use enums for sampler types (#5418) hai 1 ano
  Jared Van Bortel 1ec3332ade YaRN : store rope scaling type as int32_t in memory (#5285) %!s(int64=2) %!d(string=hai) anos
  Georgi Gerganov 5cb04dbc16 llama : remove LLAMA_MAX_DEVICES and LLAMA_SUPPORTS_GPU_OFFLOAD (#5240) %!s(int64=2) %!d(string=hai) anos
  Kawrakow 6f9939d119 KL-divergence (#5076) %!s(int64=2) %!d(string=hai) anos
  Kawrakow 7dcbe39d36 Add ability to evauate multiple choice tasks (#5047) %!s(int64=2) %!d(string=hai) anos
  Kawrakow 682986a08e Add Winogrande evaluation (#5015) %!s(int64=2) %!d(string=hai) anos