cderinbogaz commited on
Commit
73152d2
·
verified ·
1 Parent(s): 67ce511

Model card: author, benchmark charts, training-data link

Browse files
Files changed (1) hide show
  1. README.md +16 -1
README.md CHANGED
@@ -3,12 +3,24 @@ license: other
3
  library_name: laya
4
  pipeline_tag: text-classification
5
  base_model: convaiinnovations/laya
 
 
6
  language: [en, de]
7
  tags: [prompt-injection, data-exfiltration, llm-security, agent-security, laya, system-one, multilingual, onnx]
8
  ---
9
 
10
  # laya-cybersec: a fast prompt-injection and exfiltration scanner (Laya fine-tune)
11
 
 
 
 
 
 
 
 
 
 
 
12
  **laya-cybersec scores whether a piece of content that an AI agent is about to read tries to manipulate that
13
  agent: prompt injection, instruction hijacking, prompt or secret leaking, or data exfiltration. It runs in
14
  about 70–90 ms per chunk on a laptop CPU, with no data leaving your infrastructure.**
@@ -125,7 +137,8 @@ Batching and GPUs are much faster. `benchmark_results.json` has the raw numbers.
125
 
126
  - **Architecture:** Laya decision model (mmBERT-base encoder plus a 2-layer transformer decision head),
127
  initialised from `convaiinnovations/laya` (`multilingual`) and fine-tuned end-to-end.
128
- - **Data:** 194k rows, 38% German, 35% attacks.
 
129
  - Public prompt-injection datasets: neuralchemy, S-Labs, xTRam1, SPML, 3nesdeniz agentic-5k and
130
  boundary pairs, NVIDIA Nemotron agentic indirect injection, yanismiraoui.
131
  - Attacks embedded into real benign carriers, each paired with the same carrier holding a benign insert or no
@@ -158,6 +171,8 @@ Batching and GPUs are much faster. `benchmark_results.json` has the raw numbers.
158
 
159
  ## License and acknowledgements
160
 
 
 
161
  - Laya architecture, runtime and base checkpoint by Convai Innovations (Apache-2.0). mmBERT by JHU CLSP (MIT).
162
  - **Training-data licenses vary**, and one source (10kGNAD) is CC BY-NC-SA 4.0. Check them for your use case.
163
  - Jev is a product of TypeSafe AI. Its scores come from our own runs through its API (September 2026).
 
3
  library_name: laya
4
  pipeline_tag: text-classification
5
  base_model: convaiinnovations/laya
6
+ datasets:
7
+ - TextCortex/laya-cybersec-training-data
8
  language: [en, de]
9
  tags: [prompt-injection, data-exfiltration, llm-security, agent-security, laya, system-one, multilingual, onnx]
10
  ---
11
 
12
  # laya-cybersec: a fast prompt-injection and exfiltration scanner (Laya fine-tune)
13
 
14
+ **Author:** Jay Derinbogaz (TextCortex)
15
+
16
+ ![laya-cybersec: 0.93 AUROC at a quarter of Jev's latency](https://huggingface.co/TextCortex/laya-cybersec/resolve/main/charts/1_hero.png)
17
+
18
+ ![AUROC on English and German: stock Laya multilingual, laya-cybersec, TypeSafe Jev](https://huggingface.co/TextCortex/laya-cybersec/resolve/main/charts/2_auroc.png)
19
+
20
+ ![ROC curves on the English and German benchmarks](https://huggingface.co/TextCortex/laya-cybersec/resolve/main/charts/3_roc.png)
21
+
22
+ ![Median latency per chunk: laya-cybersec ONNX and PyTorch on CPU vs. the hosted Jev API](https://huggingface.co/TextCortex/laya-cybersec/resolve/main/charts/4_latency.png)
23
+
24
  **laya-cybersec scores whether a piece of content that an AI agent is about to read tries to manipulate that
25
  agent: prompt injection, instruction hijacking, prompt or secret leaking, or data exfiltration. It runs in
26
  about 70–90 ms per chunk on a laptop CPU, with no data leaving your infrastructure.**
 
137
 
138
  - **Architecture:** Laya decision model (mmBERT-base encoder plus a 2-layer transformer decision head),
139
  initialised from `convaiinnovations/laya` (`multilingual`) and fine-tuned end-to-end.
140
+ - **Data:** 194k rows, 38% German, 35% attacks. The exact training and validation files, with per-source licenses, are in
141
+ [TextCortex/laya-cybersec-training-data](https://huggingface.co/datasets/TextCortex/laya-cybersec-training-data).
142
  - Public prompt-injection datasets: neuralchemy, S-Labs, xTRam1, SPML, 3nesdeniz agentic-5k and
143
  boundary pairs, NVIDIA Nemotron agentic indirect injection, yanismiraoui.
144
  - Attacks embedded into real benign carriers, each paired with the same carrier holding a benign insert or no
 
171
 
172
  ## License and acknowledgements
173
 
174
+ - Trained and released by Jay Derinbogaz (TextCortex).
175
+
176
  - Laya architecture, runtime and base checkpoint by Convai Innovations (Apache-2.0). mmBERT by JHU CLSP (MIT).
177
  - **Training-data licenses vary**, and one source (10kGNAD) is CC BY-NC-SA 4.0. Check them for your use case.
178
  - Jev is a product of TypeSafe AI. Its scores come from our own runs through its API (September 2026).