my-tiny-audio / Modelfile
aaron-hu26's picture
Initial release: Qwen3.5-0.8B + Granite Speech 5.0 ASR and GGUF models
373d740 verified
Raw History Blame Contribute Delete
435 Bytes
# 1. 指定本地 GGUF 权重路径
FROM ./qwen_decoder_q8_0.gguf
# 2. 设置生成参数
PARAMETER temperature 0.2
PARAMETER top_p 0.9
PARAMETER stop "<|im_start|>"
PARAMETER stop "<|im_end|>"
# 3. 对齐 Qwen3.5 专用的 Chat 模板
TEMPLATE """{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{ if .Prompt }}<|im_start|>user
{{ .Prompt }}<|im_end|>
{{ end }}<|im_start|>assistant
{{ .Response }}<|im_end|>"""