Instructions to use bobboyms/tynerox with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use bobboyms/tynerox with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="bobboyms/tynerox")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("bobboyms/tynerox", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use bobboyms/tynerox with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "bobboyms/tynerox" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bobboyms/tynerox", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/bobboyms/tynerox
- SGLang
How to use bobboyms/tynerox with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "bobboyms/tynerox" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bobboyms/tynerox", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "bobboyms/tynerox" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bobboyms/tynerox", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use bobboyms/tynerox with Docker Model Runner:
docker model run hf.co/bobboyms/tynerox
Download pyproject.toml from bobboyms/tynerox: direct link, hf CLI and curl.
- Browser
- Download file 1.11 kB
-
https://huggingface.co/bobboyms/tynerox/resolve/main/pyproject.toml
- Command line
-
hf download hf://bobboyms/tynerox/pyproject.toml
-
curl -L -o pyproject.toml https://huggingface.co/bobboyms/tynerox/resolve/main/pyproject.toml
1.11 kB
| [project] | |
| name = "tynerox" | |
| version = "0.1.0" | |
| description = "" | |
| authors = [ | |
| {name = "Thiago L. Rodrigues"} | |
| ] | |
| readme = "README.md" | |
| requires-python = ">=3.9,<4.0" | |
| dependencies = [ | |
| "torch (>=2.6.0,<3.0.0)", | |
| "transformers[torch] (>=4.50.3,<5.0.0)", | |
| "python-dotenv (>=1.1.0,<2.0.0)", | |
| "tavily-python (>=0.5.3,<0.6.0)", | |
| "langchain-community (>=0.3.20,<0.4.0)", | |
| "pydantic (>=2.11.1,<3.0.0)", | |
| "pandas (>=2.2.3,<3.0.0)", | |
| "openai-agents (>=0.0.7,<0.0.8)", | |
| "datasets (>=3.5.0,<4.0.0)", | |
| "mlflow (>=2.21.3,<3.0.0)", | |
| "beautifulsoup4 (>=4.13.3,<5.0.0)", | |
| "packaging (>=24.2,<25.0)", | |
| "boto3 (>=1.37.37,<2.0.0)", | |
| "flash-attn (>=2.7.4.post1,<3.0.0)", | |
| ] | |
| [tool.poetry] | |
| name = "tynerox" | |
| version = "0.1.0" | |
| packages = [ | |
| { include = "tynerox", from = "src" } | |
| ] | |
| [build-system] | |
| requires = ["poetry-core>=2.0.0,<3.0.0"] | |
| build-backend = "poetry.core.masonry.api" | |
| [tool.poetry.group.dev.dependencies] | |
| pytest = "^8.3.5" | |
| [tool.pytest.ini_options] | |
| minversion = "6.0" | |
| addopts = "-ra -q" | |
| testpaths = ["src/tests"] | |
| python_files = ["test_*.py"] | |
| norecursedirs = ["postgres-data"] | |