Tallow / config.json
digi-the-robot's picture
add config.json
e892d8f verified
Raw History Blame Contribute Delete
100 Bytes
{
"vocab": 4096,
"ctx": 2048,
"d": 384,
"layers": 8,
"heads": 6,
"hidden": 1024
}