YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
c3-ft110m-v3
Masked diffusion language model (MDLM objective, absorbing mask, SUBS), fine-tuned for the C3 project (committed-confidence calibration in diffusion LMs).
T9 fine-tune (a): ANLP-project/c3-mdlm-110m fine-tuned for 100M tokens on the synthetic JSON probe corpus with a rho marker (W&B ft110m-v3).
| parameters | 123.9M (tied embeddings) |
| training tokens | 99,984,228 |
| steps | 18393 |
| weights | ema |
| config hash | 4d9b7db6dec4440d |
| code commit | 48b91892d4f5200361b28f80f816f38f1c148218 |
| tokenizer | GPT-2 BPE + one [MASK] token (id 50257) |
- Downloads last month
- 3
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support