surazbhandari
/

miniembed-product

Sync from GitHub Actions

d79e1fc verified 9 months ago

130 Bytes

{
    "vocab_size": 50000,
    "d_model": 256,
    "num_heads": 4,
    "num_layers": 4,
    "d_ff": 1024,
    "max_seq_len": 128
}