Text Generation
Transformers
TensorBoard
Safetensors
English
qwen3
byte-level
pretraining
symbolic
text-generation-inference
Instructions to use dotlabs/void.1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use dotlabs/void.1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="dotlabs/void.1")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("dotlabs/void.1") model = AutoModelForCausalLM.from_pretrained("dotlabs/void.1", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use dotlabs/void.1 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "dotlabs/void.1" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "dotlabs/void.1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/dotlabs/void.1
- SGLang
How to use dotlabs/void.1 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "dotlabs/void.1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "dotlabs/void.1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "dotlabs/void.1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "dotlabs/void.1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use dotlabs/void.1 with Docker Model Runner:
docker model run hf.co/dotlabs/void.1
- 1790390190216476996-4d8dc439
- 1790434090210070261-a05fc3fb
- 1790476562033999719-ba4f58e1
- 1790485060735632541-7579de36
- 1790519810984249790-cb9c9513
- 1790563279934888633-82973089
- 1790606918076636751-3952f1c5
- 1790649530872141931-069a82d8
- 1790651964532391049-1e9227c4
- 1790696019647648547-3fdea0a8
- 1790703713325746110-adad6d18
- 1790738827394728502-c744ae20
- 1790782192342215557-281f6532
- 1790824801708454555-41033672
- 1790867478897646808-aeb36a8a
- 1790868774355361490-de221e1d
- 1790911149483311115-491a3c82
- 1790911926322536473-f9bff804
- 1790914434605211575-090606d4
- 1790956870018829698-ff939fa5
- 1790989041640695387-36510d53
- 1791033297667653750-ba4975eb
- 1791039222312944374-63c10d34
- 1791083219122319327-61ae60ac
- 1791143623306220418-eb05a537
- 1791209746770022608-f3fe5fb7
- 1791254470898546162-7724d9f6
- 1791300814123050567-72be911d
- 1791342976705245012-6808dd50
- 1791399463488568880-054ba646
- 1791463982175382982-d4a3b372
- 20.5 kB