youssK
/

Boris-2 / boris_export.json
youssK's picture KlondikeDev's picture
Duplicate from opencerebral/Boris-2
c5cfc0e
Raw History Blame Contribute Delete
303 Bytes
{
"name": "Boris-2",
"tokens_seen": 200039464960,
"lineage": [
"Boris-2-0929 final.pt: 200.00B tokens (WSD, 1-sqrt decay over 174-200B)",
"+30M tokens Cosmopedia how-to / ClimbMix / math mix at 0.1x peak LR, 1-sqrt to 0",
"+10M tokens LibreMath v1 at 0.02x peak LR, 1-sqrt to 0"
]
}