writefix-models / README.md
rishi38's picture
Add WF-1 Mini and an interim WF-1 Large
656c7cc verified
|
Raw History Blame Contribute Delete
733 Bytes
metadata
language: en
tags:
  - text-correction
  - spelling
  - punctuation
  - from-scratch

WriteFix models

Two text-correction models built and trained from scratch (no pretrained weights). They fix spelling, punctuation, capitals and common grammar slips in English.

Model File Parameters Size
WF-1 Mini wf-1-mini.pt 10.5M 21 MB
WF-1 Large wf-1-large.pt 93.6M 187 MB

Both are a conv stem plus a Transformer encoder-decoder with a 16k byte-level BPE vocabulary, stored as half-precision PyTorch state dicts with their config. They load with the WriteFix code, not with transformers.

Website and live demo: https://rishiraj38.github.io/writefix-website/

Prototype. Expect mistakes.