wiki-model-tiny / config.json
Lucasgitguy-co's picture
wiki-model 0.1.0
787f661 verified
Raw History Blame Contribute Delete
110 Bytes
{
"vocab": 8192,
"dim": 320,
"layers": 8,
"heads": 8,
"hidden": 864,
"ctx": 384,
"rope_base": 10000.0
}