Piotr Wilkin (ilintar) 34fcc5a4ac model : Apertus model implementation (#15852) 3 bulan lalu
..
Apertus-8B-Instruct.jinja 34fcc5a4ac model : Apertus model implementation (#15852) 3 bulan lalu
ByteDance-Seed-OSS.jinja 60e5eee31f chat : Seed OSS thinking + tool call support (#15552) 4 bulan lalu
CohereForAI-c4ai-command-r-plus-tool_use.jinja 8b576b6c55 Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639) 11 bulan lalu
CohereForAI-c4ai-command-r7b-12-2024-tool_use.jinja bfcce4d693 `tool-call`: support Command R7B (+ return tool_plan "thoughts" in API) (#11585) 11 bulan lalu
Mistral-Small-3.2-24B-Instruct-2506.jinja 901e20bbe5 jinja : Add Mistral-Small-3.2-24B-Instruct-2506.jinja (#14349) 6 bulan lalu
NVIDIA-Nemotron-Nano-v2.jinja b2426e469e chat : nemotron thinking & toolcalling support (#15676) 4 bulan lalu
NousResearch-Hermes-2-Pro-Llama-3-8B-tool_use.jinja 8b576b6c55 Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639) 11 bulan lalu
NousResearch-Hermes-3-Llama-3.1-8B-tool_use.jinja 8b576b6c55 Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639) 11 bulan lalu
Qwen-QwQ-32B.jinja f5cd27b71d `server`: streaming of tool calls and thoughts when `--jinja` is on (#12379) 7 bulan lalu
Qwen-Qwen2.5-7B-Instruct.jinja 8b576b6c55 Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639) 11 bulan lalu
Qwen-Qwen3-0.6B.jinja e121edc432 `server`: add `--reasoning-budget 0` to disable thinking (incl. qwen3 w/ enable_thinking:false) (#13771) 7 bulan lalu
README.md 88021565f0 chat : Deepseek V3.1 reasoning and tool calling support (OpenAI Style) (#15533) 4 bulan lalu
deepseek-ai-DeepSeek-R1-Distill-Llama-8B.jinja c7f460ab88 `server`: fix tool-call of DeepSeek R1 Qwen, return reasoning_content (Command 7RB & DeepSeek R1) unless `--reasoning-format none` (#11607) 11 bulan lalu
deepseek-ai-DeepSeek-R1-Distill-Qwen-32B.jinja c7f460ab88 `server`: fix tool-call of DeepSeek R1 Qwen, return reasoning_content (Command 7RB & DeepSeek R1) unless `--reasoning-format none` (#11607) 11 bulan lalu
deepseek-ai-DeepSeek-V3.1.jinja 88021565f0 chat : Deepseek V3.1 reasoning and tool calling support (OpenAI Style) (#15533) 4 bulan lalu
fireworks-ai-llama-3-firefunction-v2.jinja 8b576b6c55 Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639) 11 bulan lalu
google-gemma-2-2b-it.jinja 8b576b6c55 Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639) 11 bulan lalu
ibm-granite-granite-3.3-2B-Instruct.jinja 3db4da56a5 chat : support Granite model reasoning and tool call (#14864) 5 bulan lalu
llama-cpp-deepseek-r1.jinja c7f460ab88 `server`: fix tool-call of DeepSeek R1 Qwen, return reasoning_content (Command 7RB & DeepSeek R1) unless `--reasoning-format none` (#11607) 11 bulan lalu
llama-cpp-rwkv-world.jinja 0d9226763c llama : add jinja template for rwkv-world (#14665) 6 bulan lalu
meetkai-functionary-medium-v3.1.jinja 8b576b6c55 Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639) 11 bulan lalu
meetkai-functionary-medium-v3.2.jinja 8b576b6c55 Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639) 11 bulan lalu
meta-llama-Llama-3.1-8B-Instruct.jinja 8b576b6c55 Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639) 11 bulan lalu
meta-llama-Llama-3.2-3B-Instruct.jinja 8b576b6c55 Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639) 11 bulan lalu
meta-llama-Llama-3.3-70B-Instruct.jinja 8b576b6c55 Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639) 11 bulan lalu
microsoft-Phi-3.5-mini-instruct.jinja 8b576b6c55 Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639) 11 bulan lalu
mistralai-Mistral-Nemo-Instruct-2407.jinja 8b576b6c55 Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639) 11 bulan lalu
moonshotai-Kimi-K2.jinja 4a4f426944 model : add Kimi-K2 support (#14654) 6 bulan lalu
openai-gpt-oss-120b.jinja b204a5a234 gpt-oss: implement harmony parsing (#15181) 5 bulan lalu
unsloth-mistral-Devstral-Small-2507.jinja 00fa15fedc mtmd : add support for Voxtral (#14862) 5 bulan lalu

README.md

These templates can be updated with the following commands:

./scripts/get_chat_template.py CohereForAI/c4ai-command-r-plus tool_use      > models/templates/CohereForAI-c4ai-command-r-plus-tool_use.jinja
./scripts/get_chat_template.py CohereForAI/c4ai-command-r7b-12-2024 default  > models/templates/CohereForAI-c4ai-command-r7b-12-2024-default.jinja
./scripts/get_chat_template.py CohereForAI/c4ai-command-r7b-12-2024 rag      > models/templates/CohereForAI-c4ai-command-r7b-12-2024-rag.jinja
./scripts/get_chat_template.py CohereForAI/c4ai-command-r7b-12-2024 tool_use > models/templates/CohereForAI-c4ai-command-r7b-12-2024-tool_use.jinja
./scripts/get_chat_template.py deepseek-ai/DeepSeek-R1-Distill-Llama-8B      > models/templates/deepseek-ai-DeepSeek-R1-Distill-Llama-8B.jinja
./scripts/get_chat_template.py deepseek-ai/DeepSeek-R1-Distill-Qwen-32B      > models/templates/deepseek-ai-DeepSeek-R1-Distill-Qwen-32B.jinja
./scripts/get_chat_template.py fireworks-ai/llama-3-firefunction-v2          > models/templates/fireworks-ai-llama-3-firefunction-v2.jinja
./scripts/get_chat_template.py google/gemma-2-2b-it                          > models/templates/google-gemma-2-2b-it.jinja
./scripts/get_chat_template.py meetkai/functionary-medium-v3.1               > models/templates/meetkai-functionary-medium-v3.1.jinja
./scripts/get_chat_template.py meetkai/functionary-medium-v3.2               > models/templates/meetkai-functionary-medium-v3.2.jinja
./scripts/get_chat_template.py meta-llama/Llama-3.1-8B-Instruct              > models/templates/meta-llama-Llama-3.1-8B-Instruct.jinja
./scripts/get_chat_template.py meta-llama/Llama-3.2-3B-Instruct              > models/templates/meta-llama-Llama-3.2-3B-Instruct.jinja
./scripts/get_chat_template.py meta-llama/Llama-3.3-70B-Instruct             > models/templates/meta-llama-Llama-3.3-70B-Instruct.jinja
./scripts/get_chat_template.py microsoft/Phi-3.5-mini-instruct               > models/templates/microsoft-Phi-3.5-mini-instruct.jinja
./scripts/get_chat_template.py mistralai/Mistral-Nemo-Instruct-2407          > models/templates/mistralai-Mistral-Nemo-Instruct-2407.jinja
./scripts/get_chat_template.py NousResearch/Hermes-2-Pro-Llama-3-8B tool_use > models/templates/NousResearch-Hermes-2-Pro-Llama-3-8B-tool_use.jinja
./scripts/get_chat_template.py NousResearch/Hermes-3-Llama-3.1-8B tool_use   > models/templates/NousResearch-Hermes-3-Llama-3.1-8B-tool_use.jinja
./scripts/get_chat_template.py Qwen/Qwen2.5-7B-Instruct                      > models/templates/Qwen-Qwen2.5-7B-Instruct.jinja
./scripts/get_chat_template.py Qwen/QwQ-32B                                  > models/templates/Qwen-QwQ-32B.jinja
./scripts/get_chat_template.py Qwen/Qwen3-0.6B                               > models/templates/Qwen-Qwen3-0.6B.jinja
./scripts/get_chat_template.py zai-org/GLM-4.5                               > models/templates/zai-org-GLM-4.5.jinja
./scripts/get_chat_template.py deepseek-ai/DeepSeek-V3.1                     > models/templates/deepseek-ai-DeepSeek-V3.1.jinja