Instructions to use tiny-random/mistral-large-4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use tiny-random/mistral-large-4 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="tiny-random/mistral-large-4")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("tiny-random/mistral-large-4")
model = AutoModelForMultimodalLM.from_pretrained("tiny-random/mistral-large-4", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use tiny-random/mistral-large-4 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "tiny-random/mistral-large-4"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "tiny-random/mistral-large-4",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/tiny-random/mistral-large-4

SGLang

How to use tiny-random/mistral-large-4 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "tiny-random/mistral-large-4" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "tiny-random/mistral-large-4",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "tiny-random/mistral-large-4" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "tiny-random/mistral-large-4",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use tiny-random/mistral-large-4 with Docker Model Runner:
```
docker model run hf.co/tiny-random/mistral-large-4
```

mistral-large-4 / chat_template.jinja

yujiepan

Upload tied tiny Mistral Large 4 checkpoint

1b8b8cd verified 2 days ago

Raw History Blame Contribute Delete

14.3 kB

{#- Default system message if no system prompt is passed. #}
{%- set default_system_message = '' %}
{#- Begin of sequence token. #}
{{- bos_token }}
{#- Handle system prompt if it exists. #}
{%- set loop_messages = messages %}
{%- if messages[0]['role'] != 'system' and default_system_message != '' %}
    {{- '[SYSTEM_PROMPT]' ~ default_system_message ~ '[/SYSTEM_PROMPT]' }}
{%- endif %}
{#- Tools and model settings definition #}
{%- set available_tools = '' %}
{%- set has_tools = false %}
{%- if tools is defined and tools is not none and tools|length > 0 %}
    {%- set has_tools = true %}
    {%- set available_tools = '[AVAILABLE_TOOLS]' ~ (tools| tojson) ~ '[/AVAILABLE_TOOLS]' %}
{%- endif %}
{%- set json_schema = none %}
{%- if response_format is defined and response_format is not none %}
    {%- set response_format_type = response_format.get('type', 'text') %}
    {%- set response_json_schema = response_format.get('json_schema') %}
    {%- if response_format_type not in ['text', 'json_object', 'json_schema'] %}
        {{- raise_exception('Response format type must be one of text, json_object or json_schema, got ' ~ response_format_type ~ '.') }}
    {%- elif response_format_type == 'json_schema' %}
        {%- if response_json_schema is none or response_json_schema.get('schema') is none %}
            {{- raise_exception('Response format `json_schema` must define the schema') }}
        {%- else %}
            {%- set json_schema = response_json_schema['schema'] %}
        {%- endif %}
    {%- elif response_format_type == 'json_object' %}
        {%- set json_schema = {'anyOf': [{'type': 'object'}, {'type': 'array'}]} %}
    {%- endif %}
{%- endif %}
{%- if reasoning_effort is not defined or reasoning_effort is none %}
    {%- set reasoning_effort = 'high' %}
{%- endif %}
{%- if reasoning_effort not in ['low', 'medium', 'high'] %}
    {{- raise_exception('reasoning_effort must be one of "low", "medium", "high"') }}
{%- endif %}
{%- set model_settings_parts = [] %}
{%- if json_schema is not none %}
    {%- set model_settings_parts = model_settings_parts + ['"json_schema": ' ~ (json_schema|tojson)] %}
{%- endif %}
{%- set model_settings_parts = model_settings_parts + ['"reasoning_effort": "' ~ reasoning_effort ~ '"'] %}
{%- set model_settings = '' %}
{%- if model_settings_parts %}
    {%- set model_settings = '[MODEL_SETTINGS]{' ~ model_settings_parts|join(', ') ~ '}[/MODEL_SETTINGS]' %}
{%- endif %}
{#- Macros #}
{%- macro render_content(content, context_name, supported_types_desc, support_thinking, support_images) -%}
    {%- if content is string -%}
        {{- content -}}
    {%- elif content -%}
        {%- for block in content -%}
            {%- if block['type'] == 'text' -%}
                {{- block['text'] -}}
            {%- elif support_thinking and block['type'] == 'thinking' -%}
                {{- '[THINK]' ~ block['thinking'] -}}
                {%- if block.get('closed', true) -%}{{- '[/THINK]' -}}{%- endif -%}
            {%- elif support_images and block['type'] in ['image', 'image_url'] -%}
                {{- '[IMG]' -}}
            {%- else -%}
                {{- raise_exception('Only ' ~ supported_types_desc ~ ' chunks are supported in ' ~ context_name ~ '.') -}}
            {%- endif -%}
        {%- endfor -%}
    {%- else -%}
        {{- raise_exception(context_name ~ ' must have non-empty content.') -}}
    {%- endif -%}
{%- endmacro -%}
{#- Aggregate consecutive messages with the same role except system and tool. #}
{#- A sentinel message is appended so the last group gets flushed inside the loop. #}
{%- set ns_agg = namespace(messages=[], current_group=[], current_role=none) %}
{%- for message in loop_messages + [{'role': '__sentinel__'}] %}
    {%- if message['role'] != ns_agg.current_role or message['role'] == 'system' or message['role'] == 'tool' %}
        {%- if ns_agg.current_role == 'tool' %}
            {%- set ns_agg.messages = ns_agg.messages + ns_agg.current_group %}
        {%- elif ns_agg.current_role is not none %}
            {%- set ns_c = namespace(text_parts=[], chunks=[], has_non_text=false, tool_calls=[]) %}
            {%- for msg in ns_agg.current_group %}
                {#- Convert reasoning / reasoning_content to a leading thinking chunk. #}
                {%- set reasoning = msg.get('reasoning_content', msg.get('reasoning', none)) %}
                {%- if reasoning is not none and reasoning != '' %}
                    {%- if msg['content'] is not none and msg['content'] is not string %}
                        {%- for block in msg['content'] %}
                            {%- if block['type'] == 'thinking' %}
                                {{- raise_exception('Message cannot have both thinking chunks in content and a top-level `reasoning` or `reasoning_content` field.') }}
                            {%- endif %}
                        {%- endfor %}
                    {%- endif %}
                    {%- set think_chunk = {'type': 'thinking', 'thinking': reasoning} %}
                    {%- if msg['content'] is string and msg['content'] != '' %}
                        {%- set new_content = [think_chunk, {'type': 'text', 'text': msg['content']}] %}
                    {%- elif msg['content'] is not none and msg['content'] is not string and msg['content'] | length > 0 %}
                        {%- set new_content = [think_chunk] + msg['content'] | list %}
                    {%- else %}
                        {%- set new_content = [think_chunk] %}
                    {%- endif %}
                    {%- if msg['tool_calls'] is defined and msg['tool_calls'] is not none %}
                        {%- set msg = {'role': msg['role'], 'content': new_content, 'tool_calls': msg['tool_calls']} %}
                    {%- else %}
                        {%- set msg = {'role': msg['role'], 'content': new_content} %}
                    {%- endif %}
                {%- endif %}
                {%- if msg['content'] is string %}
                    {%- set ns_c.text_parts = ns_c.text_parts + [msg['content']] %}
                {%- elif msg['content'] is not none %}
                    {%- set ns_msg = namespace(msg_text_parts=[]) %}
                    {%- for block in msg['content'] %}
                        {%- if block['type'] == 'text' %}
                            {%- set ns_msg.msg_text_parts = ns_msg.msg_text_parts + [block['text']] %}
                        {%- else %}
                            {%- if ns_msg.msg_text_parts | length > 0 %}
                                {%- set ns_c.text_parts = ns_c.text_parts + [ns_msg.msg_text_parts | join('')] %}
                                {%- set ns_msg.msg_text_parts = [] %}
                            {%- endif %}
                            {%- if ns_c.text_parts | length > 0 %}
                                {%- set ns_c.chunks = ns_c.chunks + [{'type': 'text', 'text': ns_c.text_parts | join('\n\n')}] %}
                                {%- set ns_c.text_parts = [] %}
                            {%- endif %}
                            {%- set ns_c.chunks = ns_c.chunks + [block] %}
                            {%- set ns_c.has_non_text = true %}
                        {%- endif %}
                    {%- endfor %}
                    {%- if ns_msg.msg_text_parts | length > 0 %}
                        {%- set ns_c.text_parts = ns_c.text_parts + [ns_msg.msg_text_parts | join('')] %}
                    {%- endif %}
                {%- endif %}
                {%- if msg['tool_calls'] is defined and msg['tool_calls'] is not none %}
                    {%- set ns_c.tool_calls = ns_c.tool_calls + msg['tool_calls'] | list %}
                {%- endif %}
            {%- endfor %}
            {%- if ns_c.has_non_text %}
                {%- if ns_c.text_parts | length > 0 %}
                    {%- set ns_c.chunks = ns_c.chunks + [{'type': 'text', 'text': ns_c.text_parts | join('\n\n')}] %}
                {%- endif %}
                {%- set merged_content = ns_c.chunks %}
            {%- else %}
                {%- set merged_content = ns_c.text_parts | join('\n\n') %}
            {%- endif %}
            {%- if ns_c.tool_calls | length > 0 %}
                {%- set ns_agg.messages = ns_agg.messages + [{'role': ns_agg.current_role, 'content': merged_content, 'tool_calls': ns_c.tool_calls}] %}
            {%- else %}
                {%- set ns_agg.messages = ns_agg.messages + [{'role': ns_agg.current_role, 'content': merged_content}] %}
            {%- endif %}
        {%- endif %}
        {%- if message['role'] != '__sentinel__' %}
            {%- set ns_agg.current_group = [message] %}
            {%- set ns_agg.current_role = message['role'] %}
        {%- endif %}
    {%- else %}
        {%- set ns_agg.current_group = ns_agg.current_group + [message] %}
    {%- endif %}
{%- endfor %}
{%- set loop_messages = ns_agg.messages %}
{#- Validates message ordering. #}
{%- set ns = namespace(available_tools_and_settings_emitted=false) %}
{%- if loop_messages | length > 0 and loop_messages[0]['role'] not in ['user', 'system'] %}
    {{- raise_exception('Conversation must start with a user or system message, got ' ~ loop_messages[0]['role'] ~ '.') }}
{%- endif %}
{%- set ns_order = namespace(previous_role=none) %}
{%- for message in loop_messages %}
    {%- set current_role = message['role'] %}
    {%- if ns_order.previous_role is not none %}
        {%- if ns_order.previous_role == 'system' %}
            {%- if current_role not in ['user', 'assistant', 'system'] %}
                {{- raise_exception('Unexpected role \'' ~ current_role ~ '\' after role \'' ~ ns_order.previous_role ~ '\'') }}
            {%- endif %}
        {%- elif ns_order.previous_role == 'user' %}
            {%- if current_role not in ['assistant', 'system', 'user'] %}
                {{- raise_exception('Unexpected role \'' ~ current_role ~ '\' after role \'' ~ ns_order.previous_role ~ '\'') }}
            {%- endif %}
        {%- elif ns_order.previous_role == 'assistant' %}
            {%- if current_role not in ['assistant', 'user', 'tool'] %}
                {{- raise_exception('Unexpected role \'' ~ current_role ~ '\' after role \'' ~ ns_order.previous_role ~ '\'') }}
            {%- endif %}
        {%- elif ns_order.previous_role == 'tool' %}
            {%- if current_role not in ['assistant', 'tool', 'user'] %}
                {{- raise_exception('Unexpected role \'' ~ current_role ~ '\' after role \'' ~ ns_order.previous_role ~ '\'') }}
            {%- endif %}
        {%- endif %}
    {%- endif %}
    {%- set ns_order.previous_role = current_role %}
{%- endfor %}
{#- Handle conversation messages. #}
{%- for message in loop_messages %}
    {#- User messages supports text, image and image_url content. #}
    {%- if message['role'] == 'user' %}
        {%- if not ns.available_tools_and_settings_emitted %}
            {{- available_tools }}
            {{- model_settings }}
            {%- set ns.available_tools_and_settings_emitted = true %}
        {%- endif %}
        {%- if message['content'] is not string and message['content'] %}
            {#- When content has exactly one image and one text block, put image first. #}
            {%- if message['content'] | length == 2 and message['content'][0]['type'] == 'text' and message['content'][1]['type'] in ['image', 'image_url'] %}
                {%- set blocks = [message['content'][1], message['content'][0]] %}
            {%- else %}
                {%- set blocks = message['content'] %}
            {%- endif %}
            {%- set user_content = blocks %}
        {%- else %}
            {%- set user_content = message['content'] %}
        {%- endif %}
        {{- '[INST]' -}}
        {{- render_content(content=user_content, context_name='user message content', supported_types_desc='text, image and image_url', support_thinking=false, support_images=true) -}}
        {{- '[/INST]' }}
    {#- Assistant messages supports text and thinking content. #}
    {%- elif message['role'] == 'assistant' %}
        {%- if (message['content'] is none or message['content'] == '' or message['content']|length == 0) and (message['tool_calls'] is not defined or message['tool_calls'] is none or message['tool_calls']|length == 0) %}
            {{- raise_exception('Assistant message must have a string or a list of chunks in content or a list of tool calls.') }}
        {%- endif %}
        {%- if message['content'] %}
            {{- render_content(content=message['content'], context_name='assistant message contents', supported_types_desc='text and thinking', support_thinking=true, support_images=false) -}}
        {%- endif %}
        {%- if message['tool_calls'] is defined and message['tool_calls'] is not none and message['tool_calls']|length > 0 %}
            {%- for tool in message['tool_calls'] %}
                {{- '[TOOL_CALLS]' }}
                {%- set name = tool['function']['name'] %}
                {%- set arguments = tool['function']['arguments'] %}
                {%- if arguments is not string %}
                    {%- set arguments = arguments|tojson|safe %}
                {%- elif arguments == '' %}
                    {%- set arguments = '{}' %}
                {%- endif %}
                {{- name ~ '[ARGS]' ~ arguments }}
            {%- endfor %}
        {%- endif %}
        {{- eos_token }}
    {#- Tool messages (multimodal). #}
    {%- elif message['role'] == 'tool' %}
        {{- '[TOOL_RESULTS]' -}}
        {{- render_content(content=message['content'], context_name='tool message contents', supported_types_desc='text and image', support_thinking=false, support_images=true) -}}
        {{- '[/TOOL_RESULTS]' }}
    {#- System messages. #}
    {%- elif message['role'] == 'system' %}
        {{- '[SYSTEM_PROMPT]' -}}
        {{- render_content(content=message['content'], context_name='system message contents', supported_types_desc='text', support_thinking=false, support_images=false) -}}
        {{- '[/SYSTEM_PROMPT]' -}}
    {#- Raise exception for unsupported roles. #}
    {%- else %}
        {{- raise_exception('Only user, assistant, system and tool roles are supported, got ' ~ message['role'] ~ '.') }}
    {%- endif %}
{%- endfor %}

	{#- Default system message if no system prompt is passed. #}
	{%- set default_system_message = '' %}

	{#- Begin of sequence token. #}
	{{- bos_token }}


	{#- Handle system prompt if it exists. #}
	{%- set loop_messages = messages %}
	{%- if messages[0]['role'] != 'system' and default_system_message != '' %}
	{{- '[SYSTEM_PROMPT]' ~ default_system_message ~ '[/SYSTEM_PROMPT]' }}
	{%- endif %}


	{#- Tools and model settings definition #}
	{%- set available_tools = '' %}
	{%- set has_tools = false %}
	{%- if tools is defined and tools is not none and tools\|length > 0 %}
	{%- set has_tools = true %}
	{%- set available_tools = '[AVAILABLE_TOOLS]' ~ (tools\| tojson) ~ '[/AVAILABLE_TOOLS]' %}
	{%- endif %}
	{%- set json_schema = none %}
	{%- if response_format is defined and response_format is not none %}
	{%- set response_format_type = response_format.get('type', 'text') %}
	{%- set response_json_schema = response_format.get('json_schema') %}
	{%- if response_format_type not in ['text', 'json_object', 'json_schema'] %}
	{{- raise_exception('Response format type must be one of text, json_object or json_schema, got ' ~ response_format_type ~ '.') }}
	{%- elif response_format_type == 'json_schema' %}
	{%- if response_json_schema is none or response_json_schema.get('schema') is none %}
	{{- raise_exception('Response format `json_schema` must define the schema') }}
	{%- else %}
	{%- set json_schema = response_json_schema['schema'] %}
	{%- endif %}
	{%- elif response_format_type == 'json_object' %}
	{%- set json_schema = {'anyOf': [{'type': 'object'}, {'type': 'array'}]} %}
	{%- endif %}
	{%- endif %}
	{%- if reasoning_effort is not defined or reasoning_effort is none %}
	{%- set reasoning_effort = 'high' %}
	{%- endif %}
	{%- if reasoning_effort not in ['low', 'medium', 'high'] %}
	{{- raise_exception('reasoning_effort must be one of "low", "medium", "high"') }}
	{%- endif %}
	{%- set model_settings_parts = [] %}
	{%- if json_schema is not none %}
	{%- set model_settings_parts = model_settings_parts + ['"json_schema": ' ~ (json_schema\|tojson)] %}
	{%- endif %}
	{%- set model_settings_parts = model_settings_parts + ['"reasoning_effort": "' ~ reasoning_effort ~ '"'] %}
	{%- set model_settings = '' %}
	{%- if model_settings_parts %}
	{%- set model_settings = '[MODEL_SETTINGS]{' ~ model_settings_parts\|join(', ') ~ '}[/MODEL_SETTINGS]' %}
	{%- endif %}

	{#- Macros #}
	{%- macro render_content(content, context_name, supported_types_desc, support_thinking, support_images) -%}
	{%- if content is string -%}
	{{- content -}}
	{%- elif content -%}
	{%- for block in content -%}
	{%- if block['type'] == 'text' -%}
	{{- block['text'] -}}
	{%- elif support_thinking and block['type'] == 'thinking' -%}
	{{- '[THINK]' ~ block['thinking'] -}}
	{%- if block.get('closed', true) -%}{{- '[/THINK]' -}}{%- endif -%}
	{%- elif support_images and block['type'] in ['image', 'image_url'] -%}
	{{- '[IMG]' -}}
	{%- else -%}
	{{- raise_exception('Only ' ~ supported_types_desc ~ ' chunks are supported in ' ~ context_name ~ '.') -}}
	{%- endif -%}
	{%- endfor -%}
	{%- else -%}
	{{- raise_exception(context_name ~ ' must have non-empty content.') -}}
	{%- endif -%}
	{%- endmacro -%}

	{#- Aggregate consecutive messages with the same role except system and tool. #}
	{#- A sentinel message is appended so the last group gets flushed inside the loop. #}
	{%- set ns_agg = namespace(messages=[], current_group=[], current_role=none) %}
	{%- for message in loop_messages + [{'role': '__sentinel__'}] %}
	{%- if message['role'] != ns_agg.current_role or message['role'] == 'system' or message['role'] == 'tool' %}
	{%- if ns_agg.current_role == 'tool' %}
	{%- set ns_agg.messages = ns_agg.messages + ns_agg.current_group %}
	{%- elif ns_agg.current_role is not none %}
	{%- set ns_c = namespace(text_parts=[], chunks=[], has_non_text=false, tool_calls=[]) %}
	{%- for msg in ns_agg.current_group %}
	{#- Convert reasoning / reasoning_content to a leading thinking chunk. #}
	{%- set reasoning = msg.get('reasoning_content', msg.get('reasoning', none)) %}
	{%- if reasoning is not none and reasoning != '' %}
	{%- if msg['content'] is not none and msg['content'] is not string %}
	{%- for block in msg['content'] %}
	{%- if block['type'] == 'thinking' %}
	{{- raise_exception('Message cannot have both thinking chunks in content and a top-level `reasoning` or `reasoning_content` field.') }}
	{%- endif %}
	{%- endfor %}
	{%- endif %}
	{%- set think_chunk = {'type': 'thinking', 'thinking': reasoning} %}
	{%- if msg['content'] is string and msg['content'] != '' %}
	{%- set new_content = [think_chunk, {'type': 'text', 'text': msg['content']}] %}
	{%- elif msg['content'] is not none and msg['content'] is not string and msg['content'] \| length > 0 %}
	{%- set new_content = [think_chunk] + msg['content'] \| list %}
	{%- else %}
	{%- set new_content = [think_chunk] %}
	{%- endif %}
	{%- if msg['tool_calls'] is defined and msg['tool_calls'] is not none %}
	{%- set msg = {'role': msg['role'], 'content': new_content, 'tool_calls': msg['tool_calls']} %}
	{%- else %}
	{%- set msg = {'role': msg['role'], 'content': new_content} %}
	{%- endif %}
	{%- endif %}
	{%- if msg['content'] is string %}
	{%- set ns_c.text_parts = ns_c.text_parts + [msg['content']] %}
	{%- elif msg['content'] is not none %}
	{%- set ns_msg = namespace(msg_text_parts=[]) %}
	{%- for block in msg['content'] %}
	{%- if block['type'] == 'text' %}
	{%- set ns_msg.msg_text_parts = ns_msg.msg_text_parts + [block['text']] %}
	{%- else %}
	{%- if ns_msg.msg_text_parts \| length > 0 %}
	{%- set ns_c.text_parts = ns_c.text_parts + [ns_msg.msg_text_parts \| join('')] %}
	{%- set ns_msg.msg_text_parts = [] %}
	{%- endif %}
	{%- if ns_c.text_parts \| length > 0 %}
	{%- set ns_c.chunks = ns_c.chunks + [{'type': 'text', 'text': ns_c.text_parts \| join('\n\n')}] %}
	{%- set ns_c.text_parts = [] %}
	{%- endif %}
	{%- set ns_c.chunks = ns_c.chunks + [block] %}
	{%- set ns_c.has_non_text = true %}
	{%- endif %}
	{%- endfor %}
	{%- if ns_msg.msg_text_parts \| length > 0 %}
	{%- set ns_c.text_parts = ns_c.text_parts + [ns_msg.msg_text_parts \| join('')] %}
	{%- endif %}
	{%- endif %}
	{%- if msg['tool_calls'] is defined and msg['tool_calls'] is not none %}
	{%- set ns_c.tool_calls = ns_c.tool_calls + msg['tool_calls'] \| list %}
	{%- endif %}
	{%- endfor %}
	{%- if ns_c.has_non_text %}
	{%- if ns_c.text_parts \| length > 0 %}
	{%- set ns_c.chunks = ns_c.chunks + [{'type': 'text', 'text': ns_c.text_parts \| join('\n\n')}] %}
	{%- endif %}
	{%- set merged_content = ns_c.chunks %}
	{%- else %}
	{%- set merged_content = ns_c.text_parts \| join('\n\n') %}
	{%- endif %}
	{%- if ns_c.tool_calls \| length > 0 %}
	{%- set ns_agg.messages = ns_agg.messages + [{'role': ns_agg.current_role, 'content': merged_content, 'tool_calls': ns_c.tool_calls}] %}
	{%- else %}
	{%- set ns_agg.messages = ns_agg.messages + [{'role': ns_agg.current_role, 'content': merged_content}] %}
	{%- endif %}
	{%- endif %}
	{%- if message['role'] != '__sentinel__' %}
	{%- set ns_agg.current_group = [message] %}
	{%- set ns_agg.current_role = message['role'] %}
	{%- endif %}
	{%- else %}
	{%- set ns_agg.current_group = ns_agg.current_group + [message] %}
	{%- endif %}
	{%- endfor %}
	{%- set loop_messages = ns_agg.messages %}

	{#- Validates message ordering. #}
	{%- set ns = namespace(available_tools_and_settings_emitted=false) %}
	{%- if loop_messages \| length > 0 and loop_messages[0]['role'] not in ['user', 'system'] %}
	{{- raise_exception('Conversation must start with a user or system message, got ' ~ loop_messages[0]['role'] ~ '.') }}
	{%- endif %}
	{%- set ns_order = namespace(previous_role=none) %}
	{%- for message in loop_messages %}
	{%- set current_role = message['role'] %}
	{%- if ns_order.previous_role is not none %}
	{%- if ns_order.previous_role == 'system' %}
	{%- if current_role not in ['user', 'assistant', 'system'] %}
	{{- raise_exception('Unexpected role \'' ~ current_role ~ '\' after role \'' ~ ns_order.previous_role ~ '\'') }}
	{%- endif %}
	{%- elif ns_order.previous_role == 'user' %}
	{%- if current_role not in ['assistant', 'system', 'user'] %}
	{{- raise_exception('Unexpected role \'' ~ current_role ~ '\' after role \'' ~ ns_order.previous_role ~ '\'') }}
	{%- endif %}
	{%- elif ns_order.previous_role == 'assistant' %}
	{%- if current_role not in ['assistant', 'user', 'tool'] %}
	{{- raise_exception('Unexpected role \'' ~ current_role ~ '\' after role \'' ~ ns_order.previous_role ~ '\'') }}
	{%- endif %}
	{%- elif ns_order.previous_role == 'tool' %}
	{%- if current_role not in ['assistant', 'tool', 'user'] %}
	{{- raise_exception('Unexpected role \'' ~ current_role ~ '\' after role \'' ~ ns_order.previous_role ~ '\'') }}
	{%- endif %}
	{%- endif %}
	{%- endif %}
	{%- set ns_order.previous_role = current_role %}
	{%- endfor %}

	{#- Handle conversation messages. #}
	{%- for message in loop_messages %}
	{#- User messages supports text, image and image_url content. #}
	{%- if message['role'] == 'user' %}
	{%- if not ns.available_tools_and_settings_emitted %}
	{{- available_tools }}
	{{- model_settings }}
	{%- set ns.available_tools_and_settings_emitted = true %}
	{%- endif %}
	{%- if message['content'] is not string and message['content'] %}
	{#- When content has exactly one image and one text block, put image first. #}
	{%- if message['content'] \| length == 2 and message['content'][0]['type'] == 'text' and message['content'][1]['type'] in ['image', 'image_url'] %}
	{%- set blocks = [message['content'][1], message['content'][0]] %}
	{%- else %}
	{%- set blocks = message['content'] %}
	{%- endif %}
	{%- set user_content = blocks %}
	{%- else %}
	{%- set user_content = message['content'] %}
	{%- endif %}
	{{- '[INST]' -}}
	{{- render_content(content=user_content, context_name='user message content', supported_types_desc='text, image and image_url', support_thinking=false, support_images=true) -}}
	{{- '[/INST]' }}

	{#- Assistant messages supports text and thinking content. #}
	{%- elif message['role'] == 'assistant' %}
	{%- if (message['content'] is none or message['content'] == '' or message['content']\|length == 0) and (message['tool_calls'] is not defined or message['tool_calls'] is none or message['tool_calls']\|length == 0) %}
	{{- raise_exception('Assistant message must have a string or a list of chunks in content or a list of tool calls.') }}
	{%- endif %}

	{%- if message['content'] %}
	{{- render_content(content=message['content'], context_name='assistant message contents', supported_types_desc='text and thinking', support_thinking=true, support_images=false) -}}
	{%- endif %}

	{%- if message['tool_calls'] is defined and message['tool_calls'] is not none and message['tool_calls']\|length > 0 %}
	{%- for tool in message['tool_calls'] %}
	{{- '[TOOL_CALLS]' }}
	{%- set name = tool['function']['name'] %}
	{%- set arguments = tool['function']['arguments'] %}
	{%- if arguments is not string %}
	{%- set arguments = arguments\|tojson\|safe %}
	{%- elif arguments == '' %}
	{%- set arguments = '{}' %}
	{%- endif %}
	{{- name ~ '[ARGS]' ~ arguments }}
	{%- endfor %}
	{%- endif %}

	{{- eos_token }}

	{#- Tool messages (multimodal). #}
	{%- elif message['role'] == 'tool' %}
	{{- '[TOOL_RESULTS]' -}}
	{{- render_content(content=message['content'], context_name='tool message contents', supported_types_desc='text and image', support_thinking=false, support_images=true) -}}
	{{- '[/TOOL_RESULTS]' }}

	{#- System messages. #}
	{%- elif message['role'] == 'system' %}
	{{- '[SYSTEM_PROMPT]' -}}
	{{- render_content(content=message['content'], context_name='system message contents', supported_types_desc='text', support_thinking=false, support_images=false) -}}
	{{- '[/SYSTEM_PROMPT]' -}}

	{#- Raise exception for unsupported roles. #}
	{%- else %}
	{{- raise_exception('Only user, assistant, system and tool roles are supported, got ' ~ message['role'] ~ '.') }}
	{%- endif %}
	{%- endfor %}