mpgowtham commited on
Commit
ce9a6c6
·
verified ·
1 Parent(s): fc8ea0b

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +18 -10
README.md CHANGED
@@ -11,17 +11,25 @@ are 253 MB each, against GitHub's 100 MB per-file hard limit.
11
 
12
  | Directory | What it is | Held-out AUC |
13
  |---|---|---|
14
- | `ensemble_v4_persona` | From-scratch ensemble: char-CNN + BiLSTM-attention + scratch transformer, 12.3M params | 0.8278 |
15
  | `v3` | DistilBERT after the Track B online-retraining cycle, 66M params | 0.7875 |
16
- | `harm_detector` | Content-harm classifier (a separate axis from injection) | 0.9028 |
17
- | `ensemble_v5_fpr` | Persona-rebalanced ensemble — lower FPR (0.328 vs 0.363), misses one canonical short attack | 0.8237 |
18
-
19
- The recommended runtime configuration is `combined_max` — the elementwise
20
- max of `ensemble_v4_persona` and `v3`. The two fail in opposite directions
21
- (dilution gap +0.142 vs −0.303), and the combination is the only one
22
- measured with no known blind spot: 8/8 canonical short attacks and 8/8 real
23
- evasions, FNR 0.035. It is a config referencing the two members, so it is
24
- recreated locally rather than stored here.
 
 
 
 
 
 
 
 
25
 
26
  Download with `scripts/bootstrap_windows.ps1` in the repo, or manually:
27
 
 
11
 
12
  | Directory | What it is | Held-out AUC |
13
  |---|---|---|
14
+ | `ensemble_v6_smooth3` | **Recommended detector.** From-scratch ensemble (char-CNN + BiLSTM-attention + scratch transformer, 12.3M params) on the 5-source corpus | **0.9168** |
15
  | `v3` | DistilBERT after the Track B online-retraining cycle, 66M params | 0.7875 |
16
+ | `harm_detector_v3` | Content-harm classifier — a separate axis from injection | 0.8978 |
17
+ | `ensemble_v9_bal` | Same architecture on the 331k 7-source corpus. Lower FPR (0.189) and higher utility (0.811) but lower AUC | 0.8929 |
18
+ | `ensemble_v4_persona` | Superseded — previous ensemble on the 4-source corpus | 0.8278 |
19
+ | `harm_detector` | Superseded — previous harm classifier, Necent only | 0.9028 |
20
+
21
+ The recommended runtime configuration is `combined_max_v7` — the elementwise
22
+ max of `ensemble_v6_smooth3` and `v3`. The two fail in opposite directions,
23
+ and the combination is the only one measured with no known blind spot: 8/8
24
+ canonical short attacks and 8/8 real evasions, ASR 0.025, FNR 0.029. It is a
25
+ config referencing the two members, so it is recreated locally rather than
26
+ stored here.
27
+
28
+ Note that `combined_max_v7` has a *lower* AUC (0.8223) than
29
+ `ensemble_v6_smooth3` alone (0.9168), because taking a max inherits the
30
+ union of both members' false positives. AUC is the wrong criterion for this
31
+ choice — the combination exists to eliminate blind spots, not to maximise
32
+ ranking.
33
 
34
  Download with `scripts/bootstrap_windows.ps1` in the repo, or manually:
35