 matteo
|
caf5681fcb
server : support jinja extra template kwargs (Qwen3 enable_thinking feature), from command line and from client (#13196)
|
hace 6 meses |
 Sigbjørn Skjæret
|
e434e69183
common : suggest --jinja when autodetection fails (#14222)
|
hace 7 meses |
 Piotr
|
3cb203c89f
llama-chat : Do not throw when tool parsing fails (#14012)
|
hace 7 meses |
 Olivier Chafik
|
c9bbc77931
`server`: update deepseek reasoning format (pass reasoning_content as diffs) (#13933)
|
hace 7 meses |
 Georgi Gerganov
|
53f925074d
sync : vendor (#13901)
|
hace 7 meses |
|
Olivier Chafik
|
03f582ae8f
server: fix streaming crashes (#13786)
|
hace 7 meses |
|
Olivier Chafik
|
d74e94c1b3
`server`: fix format of streamed tool call deltas (diff name, fix id location) (#13800)
|
hace 7 meses |
|
Olivier Chafik
|
f13847cfb5
server: fix regression on streamed non-chat completion w/ stops (#13785)
|
hace 7 meses |
|
Olivier Chafik
|
e121edc432
`server`: add `--reasoning-budget 0` to disable thinking (incl. qwen3 w/ enable_thinking:false) (#13771)
|
hace 7 meses |
|
Olivier Chafik
|
f5cd27b71d
`server`: streaming of tool calls and thoughts when `--jinja` is on (#12379)
|
hace 7 meses |
 Olivier Chafik
|
aa48e373f2
`server`: inject date_string in llama 3.x template + fix date for firefunction v2 (#12802)
|
hace 8 meses |
 Xuan-Son Nguyen
|
8c83449cb7
server : (webui) revamp the input area, plus many small UI improvements (#13365)
|
hace 8 meses |
|
Olivier Chafik
|
b6930ebc42
`tool-call`: fix non-tool-calling grammar crashes w/ Qwen / Hermes 2 templates (#12900)
|
hace 9 meses |
|
Olivier Chafik
|
4e39a3c332
`server`: extract <think> tags from qwq outputs (#12297)
|
hace 10 meses |
|
Olivier Chafik
|
87c2630546
allow missing content in message if tool_calls provided (#12293)
|
hace 10 meses |
|
Olivier Chafik
|
669912d9a5
`tool-call`: fix Qwen 2.5 Coder support, add micro benchmarks, support trigger patterns for lazy grammars (#12034)
|
hace 10 meses |
|
Olivier Chafik
|
63e489c025
tool-call: refactor common chat / tool-call api (+ tests / fixes) (#11900)
|
hace 11 meses |
|
Olivier Chafik
|
f355229692
server: fix type promotion typo causing crashes w/ --jinja w/o tools (#11880)
|
hace 11 meses |
|
Olivier Chafik
|
c7f460ab88
`server`: fix tool-call of DeepSeek R1 Qwen, return reasoning_content (Command 7RB & DeepSeek R1) unless `--reasoning-format none` (#11607)
|
hace 11 meses |
|
Olivier Chafik
|
9f4cc8f8d3
`sync`: minja (#11641)
|
hace 11 meses |
|
Olivier Chafik
|
db288b60cb
`tool-call`: command r7b fix for normal responses (#11608)
|
hace 11 meses |
|
Olivier Chafik
|
bfcce4d693
`tool-call`: support Command R7B (+ return tool_plan "thoughts" in API) (#11585)
|
hace 11 meses |
|
Olivier Chafik
|
a83f528688
`tool-call`: fix llama 3.x and functionary 3.2, play nice w/ pydantic_ai package, update readme (#11539)
|
hace 11 meses |
|
Olivier Chafik
|
8b576b6c55
Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639)
|
hace 11 meses |
