-
tokenizer: keep the pre-fix token_bytes so published bpb numbers stay reproducible
-
tokenizer: regenerate token_bytes.pt with upstream 2ce972a raw-bytes fix (191/32768 ids corrected)
-
Model card: step 5568 is now a ready-made nanochat checkpoint (+8-rank optimizer shards)
-
meta_005568.json: add user_config so chat_sft inherits the run's LRs
-
meta_001950.json: add user_config so chat_sft inherits the run's LRs
-
Add nanochat-format d24 checkpoint (step 5568) + world_size=8 optimizer shards
-
Flag that val bpb is not comparable across the batched/varlen pipelines
-
Converter now emits nanochat optimizer shards for an SFT warm-start
-
Correct optimizer-state notes: SFT needs only the weights; W_O axis is a no-op at d24
-
Add model card, meta.json, logs, tokenizer, training source, and nanochat converter
-
Upload folder using huggingface_hub
-
initial commit
