max-0.1b method-01b ablation arms

Research artifacts: a 0.1B-parameter methodology ablation for the max model family. Each arm was trained from scratch on 1.0B tokens; files are weights only (bf16), meant as --init for fine-tuning or for evaluation, not as finished models.

arm change vs. baseline
A baseline
B no LR decay + snapshot averaging (B_avg_uniform20.pt = uniform average of 20 snapshots)
C deep-narrow shape
D document-heavy data mix
E code data in the cooldown
F2 follow-up arm

Verify downloads with SHA256SUMS. See max-0.1b-v1 for the released model.


0.1B ๋ฐฉ๋ฒ•๋ก  ๋น„๊ต ์‹คํ—˜(๊ฐ 1.0B ํ† ํฐ) ๊ฐ€์ค‘์น˜์ž…๋‹ˆ๋‹ค. ์™„์„ฑ ๋ชจ๋ธ์ด ์•„๋‹Œ ์—ฐ๊ตฌ์šฉ ์‚ฐ์ถœ๋ฌผ์ž…๋‹ˆ๋‹ค.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support