Update README.md
Browse files
README.md
CHANGED
|
@@ -7,15 +7,11 @@ tags: [qwen3, byte-level, pretraining]
|
|
| 7 |
|
| 8 |
|
| 9 |
|
| 10 |
-
# details
|
| 11 |
-
|
| 12 |
State of the art, small language model pretrained from scratch on rewrite, climbmix, openmath, ultrafineweb and cortex (our internal symbolic kernel).
|
| 13 |
|
| 14 |
259 tokens: bytes 0–255, PAD 256, BOS 257, EOS 258.
|
| 15 |
|
| 16 |
-
##
|
| 17 |
-
|
| 18 |
-
Model: `appvoid/void-byte` · Checkpoint: Step 900,000
|
| 19 |
|
| 20 |
| Benchmark | Score |
|
| 21 |
| ---------------------------- | ------- |
|
|
|
|
| 7 |
|
| 8 |
|
| 9 |
|
|
|
|
|
|
|
| 10 |
State of the art, small language model pretrained from scratch on rewrite, climbmix, openmath, ultrafineweb and cortex (our internal symbolic kernel).
|
| 11 |
|
| 12 |
259 tokens: bytes 0–255, PAD 256, BOS 257, EOS 258.
|
| 13 |
|
| 14 |
+
## Results
|
|
|
|
|
|
|
| 15 |
|
| 16 |
| Benchmark | Score |
|
| 17 |
| ---------------------------- | ------- |
|