Instructions to use bobboyms/tynerox with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use bobboyms/tynerox with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="bobboyms/tynerox")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("bobboyms/tynerox", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use bobboyms/tynerox with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "bobboyms/tynerox" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bobboyms/tynerox", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/bobboyms/tynerox
- SGLang
How to use bobboyms/tynerox with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "bobboyms/tynerox" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bobboyms/tynerox", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "bobboyms/tynerox" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bobboyms/tynerox", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use bobboyms/tynerox with Docker Model Runner:
docker model run hf.co/bobboyms/tynerox
Download nginx.conf from bobboyms/tynerox: direct link, hf CLI and curl.
- Browser
- Download file 1.33 kB
-
https://huggingface.co/bobboyms/tynerox/resolve/main/nginx.conf
- Command line
-
hf download hf://bobboyms/tynerox/nginx.conf
-
curl -L -o nginx.conf https://huggingface.co/bobboyms/tynerox/resolve/main/nginx.conf
1.33 kB
| # mlflow_proxy.conf | |
| upstream mlflow { | |
| server mlflow:5000; | |
| } | |
| # upstream minio { | |
| # server minio:9000; | |
| # } | |
| server { | |
| listen 80; | |
| server_name _; # Opcional: escuta em qualquer nome de host | |
| # Logs específicos para este server block (ajuda na depuração) | |
| access_log /var/log/nginx/mlflow_access.log; | |
| error_log /var/log/nginx/mlflow_error.log debug; # Use 'debug' para mais detalhes | |
| location / { | |
| proxy_pass http://mlflow; | |
| proxy_set_header Host $host; | |
| proxy_set_header X-Real-IP $remote_addr; | |
| # Headers úteis para proxys reversos | |
| proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for; | |
| proxy_set_header X-Forwarded-Proto $scheme; | |
| # Opcional: Aumentar timeouts se houver problemas de conexão | |
| # proxy_connect_timeout 60s; | |
| # proxy_read_timeout 60s; | |
| } | |
| # location /minio { | |
| # # Atenção: MinIO pode precisar de reescrita de URL ou configuração específica | |
| # # dependendo de como ele lida com subpastas. | |
| # proxy_pass http://minio; | |
| # proxy_set_header Host $host; # MinIO pode precisar do host correto | |
| # proxy_set_header X-Real-IP $remote_addr; | |
| # proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for; | |
| # proxy_set_header X-Forwarded-Proto $scheme; | |
| # } | |
| } |