j0no12's picture
Publish Nero Optimizer Work checkpoint: SimOW
bff5711 verified
Raw History Blame Contribute Delete
231 Bytes
{
"optimizer": "simow",
"backend": "mlx",
"manifest": "/Users/jonah/Documents/ChatGPT/Training/data/prepared/finephrase-balanced-500m-2k-v2/manifest.json",
"context": 128,
"target_tokens": 500000000,
"batch_size": 32
}