frozenleaves/vllm-dev
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

[Bugfix] set system_message in phi4mini chat template (#23309)

Browse Source 
Signed-off-by: zhuangqh <zhuangqhc@gmail.com>
This commit is contained in:
jerryzhuang
2025-08-22 00:22:39 +10:00
committed by GitHub
parent c8e33c72c6
commit f8daddcc4c
1 changed files with 10 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

18
examples/tool_chat_template_phi4_mini.jinja
View File

@ -1,10 +1,14 @@
{%- if messages %} {%- if messages and messages[0]['role'] == 'system' %}
{%- if system_message or tools %} {%- set system_message = messages[0]['content']|trim %}
<|system|> {%- set messages = messages[1:] %}
{%- else %}
{%- if system_message %} {%- set system_message = "You are a helpful assistant." %}
{{ system_message }}
{%- endif %} {%- endif %}
{%- if messages %}
<|system|>
{{ system_message }}
{%- if tools %}
In addition to plain text responses, you can chose to call one or more of the provided functions. In addition to plain text responses, you can chose to call one or more of the provided functions.
Use the following rule to decide when to call a function: Use the following rule to decide when to call a function:
@ -19,13 +23,11 @@ If you decide to call functions:
* make sure you pick the right functions that match the user intent * make sure you pick the right functions that match the user intent
{%- if tools %}
{%- for t in tools %} {%- for t in tools %}
{{- t | tojson(indent=4) }} {{- t | tojson(indent=4) }}
{{- "\n\n" }} {{- "\n\n" }}
{%- endfor %} {%- endfor %}
{%- endif %}<|end|> {%- endif %}<|end|>
{%- endif %}
{%- for message in messages %} {%- for message in messages %}
{%- if message.role != "system" %} {%- if message.role != "system" %}