Text Generation
Transformers
TensorBoard
Safetensors
llama
trl
sft
Generated from Trainer
text-generation-inference
Instructions to use EddyGiusepe/tinyllama-aira_Chatbot-lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use EddyGiusepe/tinyllama-aira_Chatbot-lora with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="EddyGiusepe/tinyllama-aira_Chatbot-lora")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("EddyGiusepe/tinyllama-aira_Chatbot-lora") model = AutoModelForCausalLM.from_pretrained("EddyGiusepe/tinyllama-aira_Chatbot-lora", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use EddyGiusepe/tinyllama-aira_Chatbot-lora with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "EddyGiusepe/tinyllama-aira_Chatbot-lora" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "EddyGiusepe/tinyllama-aira_Chatbot-lora", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/EddyGiusepe/tinyllama-aira_Chatbot-lora
- SGLang
How to use EddyGiusepe/tinyllama-aira_Chatbot-lora with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "EddyGiusepe/tinyllama-aira_Chatbot-lora" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "EddyGiusepe/tinyllama-aira_Chatbot-lora", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "EddyGiusepe/tinyllama-aira_Chatbot-lora" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "EddyGiusepe/tinyllama-aira_Chatbot-lora", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use EddyGiusepe/tinyllama-aira_Chatbot-lora with Docker Model Runner:
docker model run hf.co/EddyGiusepe/tinyllama-aira_Chatbot-lora
Commit History
-
Upload tokenizer
Verified signature38743b9 -
Upload LlamaForCausalLM
Verified signaturec9d7055 -
End of training
Verified signatureda0b1f8 -
Training in progress, epoch 0
Verified signaturec944c49 -
End of training
Verified signaturece38e79 -
Training in progress, epoch 0
Verified signature2c3eaf2 -
End of training
Verified signature38e187c -
Training in progress, epoch 0
Verified signature0d3200f -
Upload tokenizer
Verified signaturec6e1af0 -
Upload LlamaForCausalLM
Verified signature0f3238b -
End of training
Verified signature13b5b5d -
Training in progress, epoch 0
Verified signature6f64850 -
Upload tokenizer
Verified signature04a6f33 -
Upload LlamaForCausalLM
Verified signature1754837 -
End of training
Verified signature22dfde0 -
Training in progress, epoch 0
Verified signature4596029 -
Upload tokenizer
Verified signature2f7e3f3 -
Upload LlamaForCausalLM
Verified signatureb1aec8e -
End of training
Verified signaturee79c923 -
Training in progress, epoch 0
Verified signature7ae0a3d -
End of training
Verified signature55c8195 -
Training in progress, epoch 0
Verified signatureb8d1e96 -
End of training
Verified signature215d5a0 -
Training in progress, epoch 0
Verified signature030b94a -
End of training
Verified signatureb8f9f60 -
Training in progress, epoch 0
Verified signaturef27bbd2 -
End of training
Verified signature180eae6 -
Training in progress, epoch 0
Verified signature1252c51 -
End of training
Verified signature3924271 -
Training in progress, epoch 0
Verified signature6d9d4cc -
Upload tokenizer
Verified signatureb865406 -
Upload LlamaForCausalLM
Verified signatureae61b1e -
End of training
Verified signature6b60d92 -
Training in progress, epoch 0
Verified signaturedddeb8b -
initial commit
Verified signatureab44c5b