transformer / config.json
tdizhere's picture
Upload folder using huggingface_hub
dc12ed4 verified
Raw History Blame Contribute Delete
197 Bytes
{
"vocab_size": 94,
"n_embd": 384,
"n_head": 6,
"n_layer": 6,
"block_size": 512,
"dropout": 0.2,
"batch_size": 128,
"learning_rate": 0.0003,
"max_iter": 10000,
"val_iter": 300
}