Esko Toivonen
|
6bda7ce6c3
llama : add pre-tokenizer regexes for BLOOM and gpt3-finnish (#8850)
|
1 vuosi sitten |
Georgi Gerganov
|
45a55b91aa
llama : better replace_all (cont) (#8926)
|
1 vuosi sitten |
Douglas Hanley
|
cdd1889de6
convert : add support for XLMRoberta embedding models (#8658)
|
1 vuosi sitten |
fairydreaming
|
d3f0c7166a
Stop the generation when <|eom_id|> token is encountered - needed for Llama 3.1 tool call support (#8858)
|
1 vuosi sitten |
slaren
|
2b1f616b20
ggml : reduce hash table reset cost (#8698)
|
1 vuosi sitten |
Georgi Gerganov
|
938943cdbf
llama : move vocab, grammar and sampling into separate files (#8508)
|
1 vuosi sitten |