 Galunid
|
69a6735087
Update special token handling in conversion scripts for gpt2 derived tokenizers (#3746)
|
il y a 2 ans |
 Kerfuffle
|
a5e7dbd614
llama : validate special token ids are in range when loading GGUF model (#3635)
|
il y a 2 ans |
 goerch
|
ff5a3f0c09
Work on the BPE tokenizer (#3252)
|
il y a 2 ans |
 cebtenzzre
|
1c84003c08
convert : fix vocab size when not defined in hparams (#3421)
|
il y a 2 ans |
|
Cebtenzzre
|
ecf90b1a51
gguf : make token scores and types optional (#3347)
|
il y a 2 ans |
 Meng Zhang
|
4fe09dfe66
llama : add support for StarCoder model architectures (#3187)
|
il y a 2 ans |
