mpgowtham commited on
Commit
dba6ef3
·
verified ·
1 Parent(s): 63f8f63

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +33 -0
README.md ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: pytorch
3
+ tags: [prompt-injection, security, secureagentnet]
4
+ ---
5
+
6
+ # SecureAgentNet detector checkpoints
7
+
8
+ Checkpoints for [SecureAgentNet](https://github.com/MP-GOWTHAM/SecureAgentNet).
9
+ They live here rather than in git because five of the project's checkpoints
10
+ are 253 MB each, against GitHub's 100 MB per-file hard limit.
11
+
12
+ | Directory | What it is | Held-out AUC |
13
+ |---|---|---|
14
+ | `ensemble_v4_persona` | From-scratch ensemble: char-CNN + BiLSTM-attention + scratch transformer, 12.3M params | 0.8278 |
15
+ | `v3` | DistilBERT after the Track B online-retraining cycle, 66M params | 0.7875 |
16
+ | `harm_detector` | Content-harm classifier (a separate axis from injection) | 0.9028 |
17
+
18
+ The recommended runtime configuration is `combined_max` — the elementwise
19
+ max of `ensemble_v4_persona` and `v3`. The two fail in opposite directions
20
+ (dilution gap +0.142 vs −0.303), and the combination is the only one
21
+ measured with no known blind spot: 8/8 canonical short attacks and 8/8 real
22
+ evasions, FNR 0.035. It is a config referencing the two members, so it is
23
+ recreated locally rather than stored here.
24
+
25
+ Download with `scripts/bootstrap_windows.ps1` in the repo, or manually:
26
+
27
+ ```python
28
+ from huggingface_hub import snapshot_download
29
+ snapshot_download(repo_id="mpgowtham/secureagentnet-models", local_dir="secureagentnet/data/models")
30
+ ```
31
+
32
+ See the repository's `docs/SecureAgentNet_Detector_Architecture.docx` for
33
+ the full evaluation, including the configurations that failed.