Text Generation
Transformers
Safetensors
English
text-generation-inference
unsloth
llama
trl
conversational
Instructions to use T3lli/test with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use T3lli/test with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="T3lli/test") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("T3lli/test", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use T3lli/test with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "T3lli/test" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "T3lli/test", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/T3lli/test
- SGLang
How to use T3lli/test with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "T3lli/test" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "T3lli/test", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "T3lli/test" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "T3lli/test", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Unsloth Desktop
- Docker Model Runner
How to use T3lli/test with Docker Model Runner:
docker model run hf.co/T3lli/test
Commit History
-
Training in progress, step 3750
Verified signature50a1a72 -
Training in progress, step 3700
Verified signature3fba1d7 -
Training in progress, step 3650
Verified signaturee6a21e0 -
Training in progress, step 3600
Verified signature56c0945 -
Training in progress, step 3550
Verified signature51ce127 -
Training in progress, step 3500
Verified signaturee2fbd31 -
Training in progress, step 3400
Verified signature19b06f0 -
Training in progress, step 3350
Verified signaturec544463 -
Training in progress, step 3300
Verified signaturef61b4a2 -
Training in progress, step 3250
Verified signature7ab993f -
Training in progress, step 3200
Verified signaturef13cf6e -
Training in progress, step 3150
Verified signaturea263d0d -
Training in progress, step 3100
Verified signature910aab6 -
Training in progress, step 3050
Verified signaturec09ff1a -
Training in progress, step 3000
Verified signature87d475d -
Training in progress, step 2950
Verified signature5348672 -
Training in progress, step 2900
Verified signature76a5bb4 -
Training in progress, step 2850
Verified signature7628048 -
Training in progress, step 2800
Verified signature03d800b -
Training in progress, step 2750
Verified signature6be9afd -
Training in progress, step 2700
Verified signatureaf3039c -
Training in progress, step 2650
Verified signaturee73b631 -
Training in progress, step 2600
Verified signaturebd0ac5d -
Training in progress, step 2550
Verified signature014694c -
Training in progress, step 2500
Verified signature7598264 -
Training in progress, step 2450
Verified signaturec543f44 -
Training in progress, step 2400
Verified signature8858107 -
Training in progress, step 2350
Verified signature1a1a4c0 -
Training in progress, step 2300
Verified signaturefeb55a0 -
Training in progress, step 2250
Verified signature1d43268 -
Training in progress, step 2200
Verified signature62aa809 -
Training in progress, step 2150
Verified signature1d69205 -
Training in progress, step 2100
Verified signaturead731dc -
Training in progress, step 2050
Verified signature21b830e -
Training in progress, step 2000
Verified signature60f09e8 -
Training in progress, step 1950
Verified signature9959ab3 -
Training in progress, step 1900
Verified signaturecf2a37e -
Training in progress, step 1850
Verified signature5a40c9d -
Training in progress, step 1800
Verified signature5f715db -
Training in progress, step 1750
Verified signaturebf40add -
Training in progress, step 1700
Verified signaturedd2ef4d -
Training in progress, step 1650
Verified signatureca5e611 -
Training in progress, step 1600
Verified signaturee91e894 -
Training in progress, step 1550
Verified signatureed4572b -
Training in progress, step 1500
Verified signature792104c -
Training in progress, step 1450
Verified signature7f8b1ab -
Training in progress, step 1400
Verified signaturefb0c82c -
Training in progress, step 1350
Verified signature90b5de3 -
Training in progress, step 1300
Verified signature6ae8543 -
Training in progress, step 1250
Verified signature8a2b3ce