Dowon
|
576c82eda2
vocab : add midm-2.0 model pre-tokenizer (#14626)
|
6 months ago |
Ryan Mangeno
|
4bb625b713
Smoldocling support (#14597)
|
6 months ago |
Dowon
|
ffd59e7d18
model : add skt/A.X-4.0 model vocabulary (#14589)
|
6 months ago |
ibrahim khadraoui
|
04655063c4
model : add support for Falcon-H1 family (#14534)
|
6 months ago |
Xuan-Son Nguyen
|
8f22dc0a53
model : add hunyuan moe (#14425)
|
6 months ago |
Sigbjørn Skjæret
|
22015b2092
lint : remove trailing whitepace (#14304)
|
7 months ago |
Ruikai Peng
|
dd6e6d0b6a
vocab : prevent tokenizer overflow (#14301)
|
7 months ago |
Sigbjørn Skjæret
|
88fc854b4b
llama : improve sep token handling (#14272)
|
7 months ago |
fanyang
|
456af35eb7
build : suppress gcc15 compile warnings (#14261)
|
7 months ago |
Bartowski
|
d7da8dc83a
model : Add support for Arcee AI's upcoming AFM model (#14185)
|
7 months ago |
Georgi Gerganov
|
fb85a288d7
vocab : fix build (#14175)
|
7 months ago |
Guy Goldenberg
|
3cfbbdb44e
Merge commit from fork
|
7 months ago |
Georgi Gerganov
|
c33fe8b8c4
vocab : prevent heap overflow when vocab is too small (#14145)
|
7 months ago |
Sigbjørn Skjæret
|
9f47fa5792
vocab : warn about missing mask token (#14022)
|
7 months ago |
Sigbjørn Skjæret
|
5e1c3aed40
convert : fix nomic-bert-moe mask token (#13757)
|
7 months ago |
Sigbjørn Skjæret
|
c3a2624339
vocab : fix ugm tokenizer precision (#13743)
|
8 months ago |
Johannes Gäßler
|
10d2af0eaa
llama/ggml: add LLM training support (#10544)
|
8 months ago |
Sigbjørn Skjæret
|
d2a4ef05c6
vocab : add ByteDance-Seed/Seed-Coder (#13423)
|
8 months ago |
Xuan-Son Nguyen
|
ecda2ec4b3
mtmd : Support Pixtral 12B (#13065)
|
9 months ago |
Mikko Juola
|
971f245b3b
llama : recognize IBM Granite 3.3 FIM tokens (#12988)
|
9 months ago |
Yuxuan Zhang
|
06bb53ad9b
llama-model : add Glm4Model implementation for GLM-4-0414 (#12867)
|
9 months ago |
Xuan-Son Nguyen
|
1466621e73
llama : Support llama 4 text-only (#12791)
|
9 months ago |
yumeyao
|
5dd5d1ab00
vocab : use string_view::find() to avoid unnecessary looking up beyond the fragment range (#12706)
|
9 months ago |
Sigbjørn Skjæret
|
83a88bd6af
vocab : BailingMoE : change possessive quantifiers to greedy (#12677)
|
9 months ago |
Daniel Bevenius
|
c80a7759da
vocab : add special infill tokens for CodeLlama (#11850)
|
9 months ago |
Sigbjørn Skjæret
|
2c3f8b850a
llama : support BailingMoE (Ling) (#12634)
|
9 months ago |
Juyoung Suk
|
b3de7cac73
llama : add Trillion 7B model support (#12556)
|
9 months ago |
compilade
|
00d53800e0
llama-vocab : add SuperBPE pre-tokenizer (#12532)
|
10 months ago |
mgroeber9110
|
5bbe6a9fe9
ggml : portability fixes for VS 2017 (#12150)
|
10 months ago |
Xuan-Son Nguyen
|
c43a3e7996
llama : add Phi-4-mini support (supersede #12099) (#12108)
|
10 months ago |