Text Generation
Safetensors
English
gpt2
dataset-mixing
pretraining
Eval Results (legacy)

Commit History

  1. Fix dataset composition percentages and token counts

    Verified signature
    ea63110
  2. Fix dataset mix to 50-30-20 and update code snippet with better generation params

    Verified signature
    5045572
  3. Fix citation to reference blog post

    Verified signature
    7ba6110

  1. Update README.md

    Verified signature
    39e5c69
  2. Update README.md

    Verified signature
    162978d
  3. Update README.md

    Verified signature
    dd65546
  4. Add comprehensive model card with benchmark results

    Verified signature
    a61f958
  5. Upload GPT-2 70M model trained with 40-30-30 dataset mixing (1B tokens)

    Verified signature
    9fac7e5
  6. initial commit

    Verified signature
    7e025de