vadimbelsky commited on
Commit
884a71c
·
verified ·
1 Parent(s): b1a3621

Card: pointer to the document-type head preview (branch doc-head-v1)

Browse files
Files changed (1) hide show
  1. README.md +20 -0
README.md CHANGED
@@ -202,6 +202,26 @@ it was evaluated in an earlier run and cost more accuracy than it added.
202
  Training stack: `transformers==4.57.1`, `tokenizers==0.22.1`, `torch==2.9.0a0`,
203
  `faker==37.12.0`; two epochs.
204
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
205
  ## Licence
206
 
207
  Proprietary to ScienceSoft. The weights are published so that the results on this page can be
 
202
  Training stack: `transformers==4.57.1`, `tokenizers==0.22.1`, `torch==2.9.0a0`,
203
  `faker==37.12.0`; two epochs.
204
 
205
+ ## Document-type classification head (preview)
206
+
207
+ A document-type head is available on the branch
208
+ [`doc-head-v1`](https://huggingface.co/ScienceSoft/scnsoft-pii-encoder/tree/doc-head-v1). It adds a second output,
209
+ `doc_logits`, to the same graph. The head reads 450-character windows and estimates what kind of document a text
210
+ is: a contract, a proposal, source code and so on. This revision (`main`) is unchanged.
211
+
212
+ - **The PII output is byte-identical** to this revision's, on every row of the PII release check (int8 and fp32,
213
+ onnxruntime 1.19.2 and 1.24.2).
214
+ - **What the head decides.** `tech.source_code` is the one type the head decides on its own. On a held-out set in
215
+ seven languages it scores F1 0.845 (seed 1234) and 0.848 (seed 4321), against 0.614 for a rule-based classifier. It
216
+ flags no benign item in any language, not counting 55 benign items that themselves contain source code; counting
217
+ them, one seed flags 1 of 18,704. Seven more types carry advisory scores, which a rule-based classifier decides in
218
+ the product.
219
+ - **Languages.** Trained and evaluated in English, German, French, Italian, Spanish, Russian and Arabic.
220
+ - **Try it in the browser:** [vadimbelsky/scnsoft-pii-encoder-demo](https://huggingface.co/spaces/vadimbelsky/scnsoft-pii-encoder-demo).
221
+ It shows PII entities and document types together, for text that stays on your device.
222
+
223
+ The branch's card has the evaluation, the decision rule, usage code and the limitations.
224
+
225
  ## Licence
226
 
227
  Proprietary to ScienceSoft. The weights are published so that the results on this page can be