Text Generation
Transformers
TensorBoard
Safetensors
English
qwen3
byte-level
pretraining
symbolic
text-generation-inference
Instructions to use dotlabs/void.1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use dotlabs/void.1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="dotlabs/void.1")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("dotlabs/void.1") model = AutoModelForCausalLM.from_pretrained("dotlabs/void.1", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use dotlabs/void.1 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "dotlabs/void.1" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "dotlabs/void.1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/dotlabs/void.1
- SGLang
How to use dotlabs/void.1 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "dotlabs/void.1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "dotlabs/void.1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "dotlabs/void.1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "dotlabs/void.1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use dotlabs/void.1 with Docker Model Runner:
docker model run hf.co/dotlabs/void.1
Update README.md
Browse files
README.md
CHANGED
|
@@ -9,12 +9,31 @@ tags: [qwen3, byte-level, pretraining]
|
|
| 9 |
|
| 10 |
# details
|
| 11 |
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
90,148,352 tied-embedding parameters.
|
| 15 |
|
| 16 |
259 tokens: bytes 0–255, PAD 256, BOS 257, EOS 258.
|
| 17 |
|
| 18 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
|
| 20 |
-
|
|
|
|
| 9 |
|
| 10 |
# details
|
| 11 |
|
| 12 |
+
State of the art, small language model pretrained from scratch on rewrite, climbmix, openmath, ultrafineweb and cortex (our internal symbolic kernel).
|
|
|
|
|
|
|
| 13 |
|
| 14 |
259 tokens: bytes 0–255, PAD 256, BOS 257, EOS 258.
|
| 15 |
|
| 16 |
+
## Benchmark Results
|
| 17 |
+
|
| 18 |
+
Model: `appvoid/void-byte` · Checkpoint: Step 900,000
|
| 19 |
+
|
| 20 |
+
| Benchmark | Score |
|
| 21 |
+
| ---------------------------- | ------- |
|
| 22 |
+
| HellaSwag | 38.68% |
|
| 23 |
+
| PIQA | 67.46% |
|
| 24 |
+
| ARC-Easy | 47.31% |
|
| 25 |
+
| ARC-Challenge | 28.16% |
|
| 26 |
+
| ArithMark-3 | 44.80% |
|
| 27 |
+
| Intelligence Index | 23.9182 |
|
| 28 |
+
| Benchmark Max Length | 2,048 |
|
| 29 |
+
|
| 30 |
+
|
| 31 |
+
| Property | Value |
|
| 32 |
+
| ------------ | ------------------------------------------------------------- |
|
| 33 |
+
| Parameters | 90,148,352 - tied-embedding |
|
| 34 |
+
| Architecture | Byte-level |
|
| 35 |
+
| Revision | `92c601560cc2179e3bfc33e067fdd3bf9254e163` |
|
| 36 |
+
|
| 37 |
+
We used the revision on step 900,000 for evaluations which trained for around 120 billion bytes which is around 30 to 35 billion bpe tokens.
|
| 38 |
|
| 39 |
+
For more details on the evals, please have a look at the official notebook.
|