File size: 145 Bytes
bfafe8d | 1 2 3 4 5 6 7 8 9 | {
"vocab_size": 10000,
"context_length": 256,
"d_model": 512,
"d_ff": 1344,
"num_layers": 4,
"num_heads": 16,
"rope_theta": 10000
} |
bfafe8d | 1 2 3 4 5 6 7 8 9 | {
"vocab_size": 10000,
"context_length": 256,
"d_model": 512,
"d_ff": 1344,
"num_layers": 4,
"num_heads": 16,
"rope_theta": 10000
} |