 Georgi Gerganov
|
e92d53b29e
sampling : optimize samplers by reusing bucket sort (#15665)
|
hai 4 meses |
 Olivier Chafik
|
f5cd27b71d
`server`: streaming of tool calls and thoughts when `--jinja` is on (#12379)
|
hai 7 meses |
 Ycros
|
39e73ae0d6
common : Add a warning when we can't match samplers from a string or char. (#13330)
|
hai 8 meses |
 oobabooga
|
233461f812
sampling : Integrate Top-nσ into main sampling chain (and add it to the server) (#13264)
|
hai 8 meses |
 Johannes Gäßler
|
dd373dd3bf
llama: fix error on bad grammar (#12628)
|
hai 9 meses |
 Olivier Chafik
|
669912d9a5
`tool-call`: fix Qwen 2.5 Coder support, add micro benchmarks, support trigger patterns for lazy grammars (#12034)
|
hai 10 meses |
 mgroeber9110
|
5bbe6a9fe9
ggml : portability fixes for VS 2017 (#12150)
|
hai 10 meses |
|
Olivier Chafik
|
c7f460ab88
`server`: fix tool-call of DeepSeek R1 Qwen, return reasoning_content (Command 7RB & DeepSeek R1) unless `--reasoning-format none` (#11607)
|
hai 11 meses |
 Vinesh Janarthanan
|
27e8a23300
sampling: add Top-nσ sampler (#11223)
|
hai 11 meses |
 Michał Moskal
|
ff227703d6
sampling : support for llguidance grammars (#10224)
|
hai 11 meses |
|
Olivier Chafik
|
8b576b6c55
Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639)
|
hai 11 meses |
|
Georgi Gerganov
|
afa8a9ec9b
llama : add `llama_vocab`, functions -> methods, naming (#11110)
|
hai 1 ano |
|
Georgi Gerganov
|
644fd71b44
sampling : refactor + optimize penalties sampler (#10803)
|
hai 1 ano |
|
Georgi Gerganov
|
d9d54e498d
speculative : refactor and add a simpler example (#10362)
|
hai 1 ano |
|
Georgi Gerganov
|
8d8ff71536
llama : remove Tail-Free sampling (#10071)
|
hai 1 ano |
 wwoodsTM
|
ff252ea48e
llama : add DRY sampler (#9702)
|
hai 1 ano |
|
Georgi Gerganov
|
55e47786e3
llama : default sampling changes + greedy update (#9897)
|
hai 1 ano |
|
Georgi Gerganov
|
755a9b2bf0
llama : add infill sampler (#9896)
|
hai 1 ano |
 MaggotHATE
|
fbc98b748e
sampling : add XTC sampler (#9742)
|
hai 1 ano |
 Diego Devesa
|
7eee341bee
common : use common_ prefix for common library functions (#9805)
|
hai 1 ano |
|
Georgi Gerganov
|
b0f27361f3
sampling : avoid expensive softmax during greedy sampling (#9605)
|
hai 1 ano |
|
Georgi Gerganov
|
6262d13e0b
common : reimplement logging (#9418)
|
hai 1 ano |
|
Georgi Gerganov
|
0abc6a2c25
llama : llama_perf + option to disable timings during decode (#9355)
|
hai 1 ano |
|
slaren
|
49006c67b4
llama : move random seed generation to the samplers (#9398)
|
hai 1 ano |
 Xuan Son Nguyen
|
bfe76d4a17
common : move arg parser code to `arg.cpp` (#9388)
|
hai 1 ano |
|
Georgi Gerganov
|
f12295b8a9
llama : fix empty ring buffer push (#9358)
|
hai 1 ano |
|
Georgi Gerganov
|
df270ef745
llama : refactor sampling v2 (#9294)
|
hai 1 ano |
|
Georgi Gerganov
|
938943cdbf
llama : move vocab, grammar and sampling into separate files (#8508)
|
hai 1 ano |
 Kevin Wang
|
470939d483
common : preallocate sampling token data vector (#8363)
|
hai 1 ano |
|
Kevin Wang
|
ffd00797d8
common : avoid unnecessary logits fetch (#8358)
|
hai 1 ano |
