j0no12's picture
Publish Nero Optimizer Work checkpoint: SimO
6654d17 verified
Raw History Blame Contribute Delete
230 Bytes
{
"optimizer": "simo",
"backend": "mlx",
"manifest": "/Users/jonah/Documents/ChatGPT/Training/data/prepared/finephrase-balanced-500m-2k-v2/manifest.json",
"context": 128,
"target_tokens": 500000000,
"batch_size": 32
}