max-0.1b method-01b ablation arms
Research artifacts: a 0.1B-parameter methodology ablation for the max model family. Each arm was trained from scratch on
1.0B tokens; files are weights only (bf16), meant as --init for fine-tuning or for evaluation, not as finished models.
| arm | change vs. baseline |
|---|---|
| A | baseline |
| B | no LR decay + snapshot averaging (B_avg_uniform20.pt = uniform average of 20 snapshots) |
| C | deep-narrow shape |
| D | document-heavy data mix |
| E | code data in the cooldown |
| F2 | follow-up arm |
Verify downloads with SHA256SUMS. See max-0.1b-v1 for the released model.
0.1B ๋ฐฉ๋ฒ๋ก ๋น๊ต ์คํ(๊ฐ 1.0B ํ ํฐ) ๊ฐ์ค์น์ ๋๋ค. ์์ฑ ๋ชจ๋ธ์ด ์๋ ์ฐ๊ตฌ์ฉ ์ฐ์ถ๋ฌผ์ ๋๋ค.
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support