KaiLu-3-Pro / Modelfile
KVC899's picture
KaiLu 3 Pro: open release (Apache-2.0), one GGUF + one safetensors
283500f verified
Raw History Blame Contribute Delete
717 Bytes
# Ollama: ollama create kailu-3-pro -f Modelfile && ollama run kailu-3-pro
FROM ./KaiLu-3-Pro-Q8_0.gguf
# KaiLu's chat format (same as chat_template.jinja): a system block, then each turn as <|role|> + text,
# with <|endoftext|> closing every assistant reply.
TEMPLATE """<|system|>
{{ if .System }}{{ .System }}{{ else }}You are KaiLu, a helpful assistant.{{ end }}
{{ range .Messages }}{{ if ne .Role "system" }}<|{{ .Role }}|>
{{ .Content }}{{ if eq .Role "assistant" }}<|endoftext|>{{ end }}
{{ end }}{{ end }}<|assistant|>
"""
PARAMETER temperature 0.2
PARAMETER top_k 50
PARAMETER repeat_penalty 1.08
PARAMETER num_ctx 1024
PARAMETER stop "<|endoftext|>"
PARAMETER stop "<|user|>"
PARAMETER stop "<|system|>"