YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
c3-ft110m-v1-dryrun
Masked diffusion language model (MDLM objective, absorbing mask, SUBS), fine-tuned for the C3 project (committed-confidence calibration in diffusion LMs).
T9 pipeline dry run: ANLP-project/c3-mdlm-110m-v1 fine-tuned for 100M tokens on the probe corpus (W&B ft110m-v1-dryrun).
| parameters | 123.9M (tied embeddings) |
| training tokens | 99,983,538 |
| steps | 12262 |
| weights | ema |
| config hash | ab9a08287d4f63ff |
| code commit | 48b91892d4f5200361b28f80f816f38f1c148218 |
| tokenizer | GPT-2 BPE + one [MASK] token (id 50257) |
- Downloads last month
- 2
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support