Olivier Chafik
|
669912d9a5
`tool-call`: fix Qwen 2.5 Coder support, add micro benchmarks, support trigger patterns for lazy grammars (#12034)
|
10 månader sedan |
Sigbjørn Skjæret
|
56d7a9f812
main: allow preloading conversation with -p and add -st / --single-turn (#12145)
|
10 månader sedan |
dm4
|
c43af9276b
tts: add speaker file support (#12048)
|
10 månader sedan |
Sigbjørn Skjæret
|
45a8e76745
common : add --system-prompt parameter, replace behavior of -p in conversation mode (#12131)
|
10 månader sedan |
Georgi Gerganov
|
abd4d0bc4f
speculative : update default params (#11954)
|
11 månader sedan |
Olivier Chafik
|
63e489c025
tool-call: refactor common chat / tool-call api (+ tests / fixes) (#11900)
|
11 månader sedan |
Daniel Bevenius
|
c48f630d1c
llama : add --completion-bash option (#11846)
|
11 månader sedan |
Olivier Chafik
|
c7f460ab88
`server`: fix tool-call of DeepSeek R1 Qwen, return reasoning_content (Command 7RB & DeepSeek R1) unless `--reasoning-format none` (#11607)
|
11 månader sedan |
Vinesh Janarthanan
|
27e8a23300
sampling: add Top-nσ sampler (#11223)
|
11 månader sedan |
bandoti
|
fef0cbeadf
cleanup: fix compile warnings associated with gnu_printf (#11811)
|
11 månader sedan |
Olivier Chafik
|
bfcce4d693
`tool-call`: support Command R7B (+ return tool_plan "thoughts" in API) (#11585)
|
11 månader sedan |
Olivier Chafik
|
8b576b6c55
Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639)
|
11 månader sedan |
Olivier Chafik
|
a94f3b2727
`common`: utils to split / join / repeat strings (from json converter) (#11342)
|
1 år sedan |
Olivier Chafik
|
6171c9d258
Add Jinja template support (#11016)
|
1 år sedan |
Georgi Gerganov
|
80d0d6b4b7
common : add -hfd option for the draft model (#11318)
|
1 år sedan |
LostRuins Concedo
|
6390a998bf
tts : add guide tokens support (#11186)
|
1 år sedan |
Radoslav Gerganov
|
667d72846c
rpc : early register backend devices (#11262)
|
1 år sedan |
Xuan Son Nguyen
|
84a44815f7
cli : auto activate conversation mode if chat template is available (#11214)
|
1 år sedan |
Xuan Son Nguyen
|
00b4c3da62
common : support tag-based --hf-repo like on ollama (#11195)
|
1 år sedan |
Georgi Gerganov
|
afa8a9ec9b
llama : add `llama_vocab`, functions -> methods, naming (#11110)
|
1 år sedan |
Georgi Gerganov
|
f66f582927
llama : refactor `src/llama.cpp` (#10902)
|
1 år sedan |
Xuan Son Nguyen
|
45095a61bf
server : clean up built-in template detection (#11026)
|
1 år sedan |
Georgi Gerganov
|
0bf2d10c55
tts : add OuteTTS support (#10784)
|
1 år sedan |
Georgi Gerganov
|
152610eda9
server : output embeddings for all tokens when pooling = none (#10861)
|
1 år sedan |
Georgi Gerganov
|
644fd71b44
sampling : refactor + optimize penalties sampler (#10803)
|
1 år sedan |
Eric Curtin
|
c27ac678dd
Opt class for positional argument handling (#10508)
|
1 år sedan |
Xuan Son Nguyen
|
adffa6ffd5
common : improve -ctv -ctk CLI arguments (#10806)
|
1 år sedan |
Xuan Son Nguyen
|
6c5bc0625f
server : (refactoring) do not rely on JSON internally (#10643)
|
1 år sedan |
haopeng
|
64ed2091b2
server: Add "tokens per second" information in the backend (#10548)
|
1 år sedan |
Xuan Son Nguyen
|
9f912511bc
common : fix duplicated file name with hf_repo and hf_file (#10550)
|
1 år sedan |