YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Training Details:

  • 200,000 steps on the Pile
  • Denoising (span corruption) objective
  • Batch size 256, 512 sequence length
  • 25B tokens total
  • Modified GPT NeoX Tokenizer
Downloads last month
4
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support