Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -11,17 +11,25 @@ are 253 MB each, against GitHub's 100 MB per-file hard limit.
|
|
| 11 |
|
| 12 |
| Directory | What it is | Held-out AUC |
|
| 13 |
|---|---|---|
|
| 14 |
-
| `
|
| 15 |
| `v3` | DistilBERT after the Track B online-retraining cycle, 66M params | 0.7875 |
|
| 16 |
-
| `
|
| 17 |
-
| `
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 25 |
|
| 26 |
Download with `scripts/bootstrap_windows.ps1` in the repo, or manually:
|
| 27 |
|
|
|
|
| 11 |
|
| 12 |
| Directory | What it is | Held-out AUC |
|
| 13 |
|---|---|---|
|
| 14 |
+
| `ensemble_v6_smooth3` | **Recommended detector.** From-scratch ensemble (char-CNN + BiLSTM-attention + scratch transformer, 12.3M params) on the 5-source corpus | **0.9168** |
|
| 15 |
| `v3` | DistilBERT after the Track B online-retraining cycle, 66M params | 0.7875 |
|
| 16 |
+
| `harm_detector_v3` | Content-harm classifier — a separate axis from injection | 0.8978 |
|
| 17 |
+
| `ensemble_v9_bal` | Same architecture on the 331k 7-source corpus. Lower FPR (0.189) and higher utility (0.811) but lower AUC | 0.8929 |
|
| 18 |
+
| `ensemble_v4_persona` | Superseded — previous ensemble on the 4-source corpus | 0.8278 |
|
| 19 |
+
| `harm_detector` | Superseded — previous harm classifier, Necent only | 0.9028 |
|
| 20 |
+
|
| 21 |
+
The recommended runtime configuration is `combined_max_v7` — the elementwise
|
| 22 |
+
max of `ensemble_v6_smooth3` and `v3`. The two fail in opposite directions,
|
| 23 |
+
and the combination is the only one measured with no known blind spot: 8/8
|
| 24 |
+
canonical short attacks and 8/8 real evasions, ASR 0.025, FNR 0.029. It is a
|
| 25 |
+
config referencing the two members, so it is recreated locally rather than
|
| 26 |
+
stored here.
|
| 27 |
+
|
| 28 |
+
Note that `combined_max_v7` has a *lower* AUC (0.8223) than
|
| 29 |
+
`ensemble_v6_smooth3` alone (0.9168), because taking a max inherits the
|
| 30 |
+
union of both members' false positives. AUC is the wrong criterion for this
|
| 31 |
+
choice — the combination exists to eliminate blind spots, not to maximise
|
| 32 |
+
ranking.
|
| 33 |
|
| 34 |
Download with `scripts/bootstrap_windows.ps1` in the repo, or manually:
|
| 35 |
|