gpt2-tensorflow / 355M /hparams.json
rasbt's picture
Mirror the four original OpenAI GPT-2 TensorFlow checkpoints
bdb1e76 verified
Raw History Blame Contribute Delete
91 Bytes
{
"n_vocab": 50257,
"n_ctx": 1024,
"n_embd": 1024,
"n_head": 16,
"n_layer": 24
}