shashwatIDR's picture
Upload Modelfile with huggingface_hub
31bc857 verified
Raw History Blame Contribute Delete
429 Bytes
FROM ./entity-v1-360m-instruct-q8_0.gguf
TEMPLATE """<|im_start|>system
{{ if .System }}{{ .System }}{{ else }}You are a helpful AI assistant named SmolLM, trained by Hugging Face{{ end }}<|im_end|>
{{ range .Messages }}<|im_start|>{{ .Role }}
{{ .Content }}<|im_end|>
{{ end }}<|im_start|>assistant
"""
SYSTEM "You are Entity, a helpful AI assistant created by Shashwat."
PARAMETER stop "<|im_end|>"
PARAMETER temperature 0.4