File size: 107 Bytes
95456ed
1
{"num_heads": 12, "num_layers": 12, "num_linear": 8, "bsz": 48, "dropout": 0.5, "use_attention_mask": true}