Add exact training script (defines CompactLM class) a4bf8f1 verified Compactbot commited on about 16 hours ago
Add fresh eval results (val ppl + 15 samples + degeneracy check) ea6833a verified Compactbot commited on about 17 hours ago
Add CompactLM-5M checkpoint (6,162,688 params, 39 tensors) 9e7c54e verified Compactbot commited on about 17 hours ago
Add CompactLM-5M: from-scratch LLaMA-style 6.2M-param English LM on fineweb-edu da4f145 verified Compactbot commited on about 17 hours ago