Text Generation
Transformers
Safetensors
English
text-generation-inference
unsloth
llama
trl
conversational
Instructions to use T3lli/test with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use T3lli/test with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="T3lli/test") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("T3lli/test", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use T3lli/test with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "T3lli/test" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "T3lli/test", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/T3lli/test
- SGLang
How to use T3lli/test with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "T3lli/test" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "T3lli/test", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "T3lli/test" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "T3lli/test", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Unsloth Desktop
- Docker Model Runner
How to use T3lli/test with Docker Model Runner:
docker model run hf.co/T3lli/test
Commit History
-
Training in progress, step 1200
Verified signature0bc2b43 -
Training in progress, step 1150
Verified signaturebfc7047 -
Training in progress, step 1100
Verified signature5e6c928 -
Training in progress, step 1050
Verified signature7047bfd -
Training in progress, step 1000
Verified signature6a91318 -
Training in progress, step 950
Verified signature85aecef -
Training in progress, step 900
Verified signature34aca5c -
Training in progress, step 850
Verified signature0a3fac4 -
Training in progress, step 800
Verified signature2fe9f81 -
Training in progress, step 750
Verified signature8d09a20 -
Training in progress, step 700
Verified signature1378260 -
Training in progress, step 650
Verified signaturec73f33e -
Training in progress, step 600
Verified signatured6d1eb0 -
Training in progress, step 550
Verified signature5b47eb7 -
Training in progress, step 500
Verified signature048e5fa -
Training in progress, step 450
Verified signatureb6208ea -
Training in progress, step 400
Verified signaturef99d196 -
Training in progress, step 350
Verified signature32288b1 -
Training in progress, step 300
Verified signature2c723fc -
Training in progress, step 250
Verified signature0603aa0 -
Training in progress, step 200
Verified signaturef870505 -
Training in progress, step 150
Verified signature3ba88cb -
Training in progress, step 100
Verified signature408fa96 -
Training in progress, step 50
Verified signaturecd689e7 -
Update README.md
Verified signature472b4af -
Update README.md
Verified signature07482ac
-
Update README.md
Verified signaturea1ab6b3 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster05a5c22 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster70941eb -
Training in progress, step 1557
Verified signatureb4055ef -
Training in progress, step 1550
Verified signaturef297f1c -
Training in progress, step 1500
Verified signatureb9e5b19 -
Training in progress, step 1450
Verified signature91602da -
Training in progress, step 1400
Verified signaturec1d69c8 -
Training in progress, step 1350
Verified signatureb331639 -
Training in progress, step 1300
Verified signature439da56 -
Training in progress, step 1250
Verified signature6611611 -
Training in progress, step 1200
Verified signaturefbb11eb -
Training in progress, step 1150
Verified signaturefdb89fe -
Training in progress, step 1100
Verified signatured40e6de -
Training in progress, step 1050
Verified signature563c68e -
Training in progress, step 1000
Verified signaturecc2655c -
Training in progress, step 950
Verified signature32b9450 -
Training in progress, step 900
Verified signatureddb0d44 -
Training in progress, step 850
Verified signature075a573 -
Training in progress, step 800
Verified signaturebe4031b -
Training in progress, step 750
Verified signature07c7bca -
Training in progress, step 700
Verified signature07f35bb -
Training in progress, step 650
Verified signature14ddaed -
Training in progress, step 600
Verified signature5b0c716