writefix-models / README.md
rishi38's picture
Add WF-1 Mini and an interim WF-1 Large
656c7cc verified
|
Raw History Blame Contribute Delete
733 Bytes
---
language: en
tags: [text-correction, spelling, punctuation, from-scratch]
---
# WriteFix models
Two text-correction models built and trained from scratch (no pretrained weights). They fix spelling, punctuation, capitals and common grammar slips in English.
| Model | File | Parameters | Size |
|---|---|---|---|
| WF-1 Mini | `wf-1-mini.pt` | 10.5M | 21 MB |
| WF-1 Large | `wf-1-large.pt` | 93.6M | 187 MB |
Both are a conv stem plus a Transformer encoder-decoder with a 16k byte-level BPE vocabulary, stored as half-precision PyTorch state dicts with their config. They load with the WriteFix code, not with `transformers`.
Website and live demo: https://rishiraj38.github.io/writefix-website/
Prototype. Expect mistakes.