Text Classification
Transformers
Safetensors
qwen3_5
skillscreen
agent-security
nli
sbr
JerroldH commited on
Commit
1e47bd2
·
verified ·
1 Parent(s): 35859cc

Keep model card concise

Browse files
Files changed (1) hide show
  1. README.md +10 -11
README.md CHANGED
@@ -16,26 +16,25 @@ tags:
16
 
17
  # SkillScreen-2B-SBR
18
 
19
- SkillScreen scores malicious agent skills directly from `SKILL.md` in one forward pass. This checkpoint uses the Source-Balanced Random (SBR) training split and an 8,192-token input budget.
20
 
21
- Fine-tuned from [OpenJev 2B](https://huggingface.co/AlexWortega/openjev/tree/a20448012c213128955ca0c693e7c943865cab77/qwen3.5-2b-nli-v5) with LoRA and a trained classification head. Seed 42, one epoch, checkpoint 426. Full merged weights are at the root. The original adapter and trained head are in `adapter/`.
22
 
23
  ## Use
24
 
25
- CUDA with BF16 support.
26
 
27
  ```bash
28
- pip install torch==2.11.0 transformers==5.17.0 huggingface_hub==1.33.0
29
- hf download SkillScreen/SkillScreen-2B-SBR --local-dir skillscreen
 
30
  python skillscreen/score.py path/to/SKILL.md
31
  ```
32
 
33
- The score is the native entailment probability. A score **≥ 0.5** is flagged as suspicious. The fixed hypothesis is `This AI agent skill is malicious.` Inputs preserve the premise prefix and the complete hypothesis.
34
 
35
- [Project page](https://jerroldh.github.io/SkillScreen-webpage/) · [Code](https://github.com/JerroldH/SkillScreen)
36
 
37
- This release contains one checkpoint. Paper aggregate results cover five training seeds. BF16 merging changes one of 973 validation decisions at 0.5. The original adapter is retained unchanged. Scores are uncalibrated, and a low score does not certify a package as safe. See `provenance.json` and `merge_verification.json` for the checkpoint and export checks.
38
 
39
- Authors: Jerrold Huang, Junwei Quan, Saiyue Lyu, Zihan Guo, Yingqiang Ge.
40
-
41
- SkillScreen-authored material is subject to `LICENSE`. Upstream rights and notices remain applicable.
 
16
 
17
  # SkillScreen-2B-SBR
18
 
19
+ 2B decision model for detecting malicious agent skills from `SKILL.md`. Trained on MaliciousSkillBench using Source-Balanced Random (SBR), with an 8K input budget.
20
 
21
+ Based on [OpenJev 2B](https://huggingface.co/AlexWortega/openjev). Full weights are at the root. The original LoRA adapter and classification head are in `adapter/`.
22
 
23
  ## Use
24
 
25
+ Requires CUDA with BF16 support.
26
 
27
  ```bash
28
+ pip install huggingface_hub
29
+ hf download SkillScreen/SkillScreen-2B-SBR --revision v1 --local-dir skillscreen
30
+ pip install -r skillscreen/requirements.txt
31
  python skillscreen/score.py path/to/SKILL.md
32
  ```
33
 
34
+ Native maliciousness score **≥ 0.5** is flagged as suspicious.
35
 
36
+ [Checkpoint details](provenance.json) · [Export verification](merge_verification.json) · [Project page](https://jerroldh.github.io/SkillScreen-webpage/) · [Code](https://github.com/JerroldH/SkillScreen)
37
 
38
+ Jerrold Huang, Junwei Quan, Saiyue Lyu, Zihan Guo, Yingqiang Ge.
39
 
40
+ [License](LICENSE) · [Third-party notices](THIRD_PARTY_NOTICES.md)