Text Generation
Transformers
Safetensors
English
text-generation-inference
unsloth
llama
trl
conversational
Instructions to use T3lli/test with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use T3lli/test with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="T3lli/test") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("T3lli/test", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use T3lli/test with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "T3lli/test" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "T3lli/test", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/T3lli/test
- SGLang
How to use T3lli/test with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "T3lli/test" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "T3lli/test", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "T3lli/test" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "T3lli/test", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Unsloth Desktop
- Docker Model Runner
How to use T3lli/test with Docker Model Runner:
docker model run hf.co/T3lli/test
Commit History
-
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster13248b9 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster8f66424 -
Training in progress, step 11150
Verified signature8e539d9 -
Training in progress, step 11100
Verified signaturea80c7e1 -
Training in progress, step 11050
Verified signature5633c35 -
Training in progress, step 11000
Verified signature77b2f75 -
Training in progress, step 10950
Verified signaturea6951f8 -
Training in progress, step 10900
Verified signaturedd442e1 -
Training in progress, step 10850
Verified signaturef0d56ea -
Training in progress, step 10800
Verified signaturee4cbec8 -
Training in progress, step 10750
Verified signature2bafec2 -
Training in progress, step 10700
Verified signature2493eb6 -
Training in progress, step 10650
Verified signature1f7cd17 -
Training in progress, step 10600
Verified signaturec2c156e -
Training in progress, step 10550
Verified signatureee4f81f -
Training in progress, step 10500
Verified signaturedd6752c -
Training in progress, step 10450
Verified signature36c0946 -
Training in progress, step 10400
Verified signatureb8f2f2d -
Training in progress, step 10350
Verified signaturecd0e618 -
Training in progress, step 10300
Verified signature0c22281 -
Training in progress, step 10250
Verified signature2cbbdf1 -
Training in progress, step 10200
Verified signaturef00f403 -
Training in progress, step 10150
Verified signaturec4699e6 -
Training in progress, step 10100
Verified signatureda27f1e -
Training in progress, step 10050
Verified signature7bbfc70 -
Training in progress, step 10000
Verified signaturea40ba25 -
Training in progress, step 9950
Verified signature1854e6a -
Training in progress, step 9900
Verified signaturee349dbf -
Training in progress, step 9850
Verified signature4d5dc76 -
Training in progress, step 9800
Verified signature6356bbc -
Training in progress, step 9750
Verified signature2095f5a -
Training in progress, step 9700
Verified signaturee4adfed -
Training in progress, step 9650
Verified signature8954292 -
Training in progress, step 9600
Verified signature39961c5 -
Training in progress, step 9550
Verified signature88ada27 -
Training in progress, step 9500
Verified signature5d53be2 -
Training in progress, step 9450
Verified signature52c4f8f -
Training in progress, step 9400
Verified signature51600b0 -
Training in progress, step 9350
Verified signature084bf1b -
Training in progress, step 9300
Verified signature2fca84a -
Training in progress, step 9250
Verified signature1a4d0d5 -
Training in progress, step 9200
Verified signature5a6c900 -
Training in progress, step 9150
Verified signaturee982236 -
Training in progress, step 9100
Verified signature6ff7ff2 -
Training in progress, step 9050
Verified signature7e91677 -
Training in progress, step 9000
Verified signatureb7445a4 -
Training in progress, step 8950
Verified signature5b5c20e -
Training in progress, step 8900
Verified signature7061737 -
Training in progress, step 8850
Verified signature1bc2ec8 -
Training in progress, step 8800
Verified signature0f0261c