divij30
/

gpt2

PyTorch

Model card Files Files and versions

xet

Community

gpt2 / config.json

divij30

Upload custom GPT model

e352ba6 verified almost 2 years ago

Raw History Blame Contribute Delete

200 Bytes

{"vocab_size": 50304, "n_positions": 1024, "n_ctx": 1024, "n_embd": 768, "n_layer": 12, "n_head": 12, "activation_function": "gelu", "resid_pdrop": 0.1, "attn_pdrop": 0.1, "summary_type": "cls_index"}