levossadtchi commited on
Commit
e09074a
·
verified ·
1 Parent(s): c8f2f25

Add the text model that runs on synthink.dev (u3ref, 60k steps) and describe it in the README

Browse files
Files changed (2) hide show
  1. README.md +12 -0
  2. ckpt_dl/u3ref/fp16/step060000_fp16.pt +3 -0
README.md CHANGED
@@ -124,12 +124,23 @@ The style vector comes from a line-level writer encoder. Fraction bars, radicals
124
  | Path | What | Size |
125
  |---|---|---|
126
  | `ckpt_dl/b4styc/fp16/step003000_fp16.pt` | text model | 45 MB |
 
127
  | `ckpt_dl/planner7/best.pt` | duration planner | 14 MB |
128
  | `ckpt_semb3_all/best.pt` | writer style encoder | 7 MB |
129
  | `ckpt_glyph_dn_u2s/fp16/step050000.pt` | glyph model | 14 MB |
130
  | `ckpt_dl/glyph_cls2.pt` | glyph classifier | 1 MB |
131
  | `trace/weights/` | tracer and ink restorer, only for the photo route | 62 MB |
132
 
 
 
 
 
 
 
 
 
 
 
133
  ## Evaluation
134
 
135
  240 lines of real notes from writers the generator never saw, each written from one reference line by the same writer. An LLM judge (Gemini 4 Argon) lists errors in each line; "clean" means no error of severity 2 or higher. Pairs are re-sampled for the 95% intervals.
@@ -161,6 +172,7 @@ Style similarity by the writer encoder (cosine to the writer's real line, one re
161
  ## Training data
162
 
163
  - **Generator models:** tablet handwriting of 13 writers who agreed to this use, about 63 000 lines and 86 000 glyphs. Writer names are removed from the weights. The notes themselves are not published.
 
164
  - **Style encoder:** the same kind of tablet data, plus traced lines of [HWR200](https://huggingface.co/datasets/AntiplagiatCompany/HWR200) (Apache-2.0).
165
  - **Tracer:** a mix of tablet notes and open sets, some with non-commercial or ShareAlike terms. See [trace/TRAINING_DATA.md](trace/TRAINING_DATA.md), including the open question about ShareAlike.
166
 
 
124
  | Path | What | Size |
125
  |---|---|---|
126
  | `ckpt_dl/b4styc/fp16/step003000_fp16.pt` | text model | 45 MB |
127
+ | `ckpt_dl/u3ref/fp16/step060000_fp16.pt` | text model of [the site](https://synthink.dev), see below; not used by `write_pages.py` | 51 MB |
128
  | `ckpt_dl/planner7/best.pt` | duration planner | 14 MB |
129
  | `ckpt_semb3_all/best.pt` | writer style encoder | 7 MB |
130
  | `ckpt_glyph_dn_u2s/fp16/step050000.pt` | glyph model | 14 MB |
131
  | `ckpt_dl/glyph_cls2.pt` | glyph classifier | 1 MB |
132
  | `trace/weights/` | tracer and ink restorer, only for the photo route | 62 MB |
133
 
134
+ ## The model on the site
135
+
136
+ [synthink.dev](https://synthink.dev) writes a line in your handwriting right in the browser: [try it there](https://synthink.dev/generate/). The text model that runs on the site is `ckpt_dl/u3ref/fp16/step060000_fp16.pt` in this repository (a PyTorch checkpoint; the site runs the same weights converted to ONNX).
137
+
138
+ It is the text model of this release trained for 60 000 more steps, with two additions: traced lines of 190 HWR200 writers in the training data, and attention from every generated point to the pen points of the reference line. The model reads the reference line itself, not only its style vector.
139
+
140
+ Measured on traced lines of 9 writers the model never saw: the cosine of a writer classifier between a generated line and the writer's own line is 0.71, against 0.47 for the release text model; to other writers it is 0.46 for both. Legibility did not change: 47.1% clean lines on the set of the table below, the same as "Text model alone". By eye the gain in likeness is modest.
141
+
142
+ `write_pages.py` does not use this checkpoint: `scrawler/text_model.py` has no reference attention yet, and the pages shown here are written by the text model of the first row. On the site every line is sampled four times and the most legible one is kept.
143
+
144
  ## Evaluation
145
 
146
  240 lines of real notes from writers the generator never saw, each written from one reference line by the same writer. An LLM judge (Gemini 4 Argon) lists errors in each line; "clean" means no error of severity 2 or higher. Pairs are re-sampled for the 95% intervals.
 
172
  ## Training data
173
 
174
  - **Generator models:** tablet handwriting of 13 writers who agreed to this use, about 63 000 lines and 86 000 glyphs. Writer names are removed from the weights. The notes themselves are not published.
175
+ - **Text model of the site:** the same, plus traced lines of 190 writers of [HWR200](https://huggingface.co/datasets/AntiplagiatCompany/HWR200) (Apache-2.0).
176
  - **Style encoder:** the same kind of tablet data, plus traced lines of [HWR200](https://huggingface.co/datasets/AntiplagiatCompany/HWR200) (Apache-2.0).
177
  - **Tracer:** a mix of tablet notes and open sets, some with non-commercial or ShareAlike terms. See [trace/TRAINING_DATA.md](trace/TRAINING_DATA.md), including the open question about ShareAlike.
178
 
ckpt_dl/u3ref/fp16/step060000_fp16.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3886f5f5d995d9fbdbfa64cfeacc768d022d4281a7e762c8f8e29e487d5e68a0
3
+ size 51085797