llm-from-scratch / tokenizer.json

Commit History

  1. Replace epoch-4 word-level checkpoint with epoch-7 BPE-tokenizer run⁠

    Verified signature
    39a09e9