Commit History

Fix card: replace hand-written sample sentences with real output from the shipped weights, and correct the capability claims to match what the model actually produces
a11a5e4
verified

Compactbot commited on

Add model card (honest: arch, data, measured val PPL 48.03, 0/15 degenerate) (#6)
cafd02f

Compactbot commited on

Add config.json (architecture params, verified 6,162,688 params) (#5)
43373af

Compactbot commited on

Add exact eval script (val PPL + generation + degeneracy check) (#4)
8c65959

Compactbot commited on

Add exact training script (defines CompactLM class) (#3)
de1cc93

Compactbot commited on

Add gollem_eval byte-level BPE tokenizer (12,288 vocab) (#2)
e1fdac6

Compactbot commited on

Add CompactLM-5M weights (39 tensors, F32, 6,162,688 params, tied embeddings) (#1)
eb6d259

Compactbot commited on

Add fresh eval results (val ppl + 15 samples + degeneracy check)
ea6833a
verified

Compactbot commited on

Add CompactLM-5M checkpoint (6,162,688 params, 39 tensors)
9e7c54e
verified

Compactbot commited on

Add CompactLM-5M: from-scratch LLaMA-style 6.2M-param English LM on fineweb-edu
da4f145
verified

Compactbot commited on

Add architecture config
a6ce552
verified

Compactbot commited on

initial commit
607e91c
verified

Compactbot commited on