Text Generation
PEFT
Safetensors
PyTorch
English
kaveri-ai
lora
fine-tuned
enterprise-slm
z3-verified
20cr-benchmark
conversational
Instructions to use shiva123782/SITAAI with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use shiva123782/SITAAI with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-0.5B-Instruct") model = PeftModel.from_pretrained(base_model, "shiva123782/SITAAI") - Notebooks
- Google Colab
- Kaggle
Download Modelfile from shiva123782/SITAAI: direct link, hf CLI and curl.
- Browser
- Download file 483 Bytes
-
https://huggingface.co/shiva123782/SITAAI/resolve/main/Modelfile
- Command line
-
hf download hf://shiva123782/SITAAI/Modelfile
-
curl -L -o Modelfile https://huggingface.co/shiva123782/SITAAI/resolve/main/Modelfile
483 Bytes
| FROM ./out/local_final/model.safetensors | |
| TEMPLATE """{{ if .System }}<|im_start|>system | |
| {{ .System }}<|im_end|> | |
| {{ end }}{{ if .Prompt }}<|im_start|>user | |
| {{ .Prompt }}<|im_end|> | |
| {{ end }}<|im_start|>assistant | |
| {{ .Response }}<|im_end|>""" | |
| PARAMETER stop "<|im_start|>" | |
| PARAMETER stop "<|im_end|>" | |
| PARAMETER temperature 0.3 | |
| SYSTEM "You are SITAAI, a sovereign enterprise AI assistant created and maintained exclusively by rama143." | |
| LABEL developer="rama143" | |
| LABEL license="Apache-2.0" | |