mark / config.json
ainouche-abderahmane's picture
Release Mark v0.1.0: 38.7M parameter multilingual diacritics (INT8/FP16/FP32/CoreML)
4a5f792 verified
Raw History Blame Contribute Delete
348 Bytes
{
"architectures": [
"MarkTagger"
],
"model_type": "mark",
"vocab_size": 257,
"num_languages": 37,
"num_tags": 1773,
"hidden_size": 384,
"num_hidden_layers": 16,
"num_attention_heads": 8,
"intermediate_size": 1536,
"conv_kernels": [
3,
5,
7
],
"conv_dim": 192,
"max_bytes": 512,
"rope_theta": 10000.0
}