Commit History

Author SHA1 Message Date
  Dowon 576c82eda2 vocab : add midm-2.0 model pre-tokenizer (#14626) 6 months ago
  Ryan Mangeno 4bb625b713 Smoldocling support (#14597) 6 months ago
  Dowon ffd59e7d18 model : add skt/A.X-4.0 model vocabulary (#14589) 6 months ago
  ibrahim khadraoui 04655063c4 model : add support for Falcon-H1 family (#14534) 6 months ago
  Xuan-Son Nguyen 8f22dc0a53 model : add hunyuan moe (#14425) 6 months ago
  Sigbjørn Skjæret 22015b2092 lint : remove trailing whitepace (#14304) 7 months ago
  Ruikai Peng dd6e6d0b6a vocab : prevent tokenizer overflow (#14301) 7 months ago
  Sigbjørn Skjæret 88fc854b4b llama : improve sep token handling (#14272) 7 months ago
  fanyang 456af35eb7 build : suppress gcc15 compile warnings (#14261) 7 months ago
  Bartowski d7da8dc83a model : Add support for Arcee AI's upcoming AFM model (#14185) 7 months ago
  Georgi Gerganov fb85a288d7 vocab : fix build (#14175) 7 months ago
  Guy Goldenberg 3cfbbdb44e Merge commit from fork 7 months ago
  Georgi Gerganov c33fe8b8c4 vocab : prevent heap overflow when vocab is too small (#14145) 7 months ago
  Sigbjørn Skjæret 9f47fa5792 vocab : warn about missing mask token (#14022) 7 months ago
  Sigbjørn Skjæret 5e1c3aed40 convert : fix nomic-bert-moe mask token (#13757) 7 months ago
  Sigbjørn Skjæret c3a2624339 vocab : fix ugm tokenizer precision (#13743) 8 months ago
  Johannes Gäßler 10d2af0eaa llama/ggml: add LLM training support (#10544) 8 months ago
  Sigbjørn Skjæret d2a4ef05c6 vocab : add ByteDance-Seed/Seed-Coder (#13423) 8 months ago
  Xuan-Son Nguyen ecda2ec4b3 mtmd : Support Pixtral 12B (#13065) 9 months ago
  Mikko Juola 971f245b3b llama : recognize IBM Granite 3.3 FIM tokens (#12988) 9 months ago
  Yuxuan Zhang 06bb53ad9b llama-model : add Glm4Model implementation for GLM-4-0414 (#12867) 9 months ago
  Xuan-Son Nguyen 1466621e73 llama : Support llama 4 text-only (#12791) 9 months ago
  yumeyao 5dd5d1ab00 vocab : use string_view::find() to avoid unnecessary looking up beyond the fragment range (#12706) 9 months ago
  Sigbjørn Skjæret 83a88bd6af vocab : BailingMoE : change possessive quantifiers to greedy (#12677) 9 months ago
  Daniel Bevenius c80a7759da vocab : add special infill tokens for CodeLlama (#11850) 9 months ago
  Sigbjørn Skjæret 2c3f8b850a llama : support BailingMoE (Ling) (#12634) 9 months ago
  Juyoung Suk b3de7cac73 llama : add Trillion 7B model support (#12556) 9 months ago
  compilade 00d53800e0 llama-vocab : add SuperBPE pre-tokenizer (#12532) 10 months ago
  mgroeber9110 5bbe6a9fe9 ggml : portability fixes for VS 2017 (#12150) 10 months ago
  Xuan-Son Nguyen c43a3e7996 llama : add Phi-4-mini support (supersede #12099) (#12108) 10 months ago