Card: pointer to the document-type head preview (branch doc-head-v1)
Browse files
README.md
CHANGED
|
@@ -202,6 +202,26 @@ it was evaluated in an earlier run and cost more accuracy than it added.
|
|
| 202 |
Training stack: `transformers==4.57.1`, `tokenizers==0.22.1`, `torch==2.9.0a0`,
|
| 203 |
`faker==37.12.0`; two epochs.
|
| 204 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 205 |
## Licence
|
| 206 |
|
| 207 |
Proprietary to ScienceSoft. The weights are published so that the results on this page can be
|
|
|
|
| 202 |
Training stack: `transformers==4.57.1`, `tokenizers==0.22.1`, `torch==2.9.0a0`,
|
| 203 |
`faker==37.12.0`; two epochs.
|
| 204 |
|
| 205 |
+
## Document-type classification head (preview)
|
| 206 |
+
|
| 207 |
+
A document-type head is available on the branch
|
| 208 |
+
[`doc-head-v1`](https://huggingface.co/ScienceSoft/scnsoft-pii-encoder/tree/doc-head-v1). It adds a second output,
|
| 209 |
+
`doc_logits`, to the same graph. The head reads 450-character windows and estimates what kind of document a text
|
| 210 |
+
is: a contract, a proposal, source code and so on. This revision (`main`) is unchanged.
|
| 211 |
+
|
| 212 |
+
- **The PII output is byte-identical** to this revision's, on every row of the PII release check (int8 and fp32,
|
| 213 |
+
onnxruntime 1.19.2 and 1.24.2).
|
| 214 |
+
- **What the head decides.** `tech.source_code` is the one type the head decides on its own. On a held-out set in
|
| 215 |
+
seven languages it scores F1 0.845 (seed 1234) and 0.848 (seed 4321), against 0.614 for a rule-based classifier. It
|
| 216 |
+
flags no benign item in any language, not counting 55 benign items that themselves contain source code; counting
|
| 217 |
+
them, one seed flags 1 of 18,704. Seven more types carry advisory scores, which a rule-based classifier decides in
|
| 218 |
+
the product.
|
| 219 |
+
- **Languages.** Trained and evaluated in English, German, French, Italian, Spanish, Russian and Arabic.
|
| 220 |
+
- **Try it in the browser:** [vadimbelsky/scnsoft-pii-encoder-demo](https://huggingface.co/spaces/vadimbelsky/scnsoft-pii-encoder-demo).
|
| 221 |
+
It shows PII entities and document types together, for text that stays on your device.
|
| 222 |
+
|
| 223 |
+
The branch's card has the evaluation, the decision rule, usage code and the limitations.
|
| 224 |
+
|
| 225 |
## Licence
|
| 226 |
|
| 227 |
Proprietary to ScienceSoft. The weights are published so that the results on this page can be
|