--- license: cc-by-nc-4.0 language: - en library_name: transformers pipeline_tag: text-classification base_model: sdmlai/nano-jev datasets: - bridge4/CSIC2010_dataset_classification - shengqin/web-attacks - notesbymuneeb/ai-waf-dataset - gretelai/synthetic_text_to_sql - S-Labs/prompt-injection-dataset - neuralchemy/Prompt-injection-dataset - Simsonsun/JailbreakPrompts - walledai/WildJailbreak - Lakera/mosscap_prompt_injection - saidutta69/awesome-chatgpt-prompts-clean - databricks/databricks-dolly-15k - flwrlabs/fed-phishing-urls tags: - security - web-application-firewall - sql-injection - xss - prompt-injection - phishing - calibration - decision-model - cross-encoder - onnx --- # Cyber-Jev v0.1 (research preview) > **Version 0.1 — research preview.** Jev-style decision model for security checks, built on > [Nano-Jev](https://huggingface.co/sdmlai/nano-jev). Independent; not affiliated with TypeSafe AI. > **A paper is in preparation** (see [Citation](#citation)). A small (22.7M parameter) **typed decision model for application-layer security text**. Give it an HTTP request, a prompt sent to an LLM, or a URL; it returns a **probability per option** in about 2–4 ms on a CPU (ONNX int8). It never generates text. It is meant as a **second-stage check behind rules or a WAF**, not as the only defence. Code: [github.com/shubham10divakar/CyberJev](https://github.com/shubham10divakar/CyberJev) | Decision | Options | Input | Status (3 training seeds) | |---|---|---|---| | `http_attack` | safe / attack | HTTP request line + headers + body, or a bare payload | strong: held-out AUROC 0.96, val 0.92 | | `phishing_url` | legitimate / phishing | a URL | beats TF-IDF out of domain: held-out 0.81 (TF-IDF 0.71), val 0.94 | | `prompt_injection` | safe / injection | text sent to an LLM | **weak out of domain**: val 0.80 (TF-IDF 0.79), held-out 0.81 (TF-IDF 0.88) | ## v0.1 specs | | | |---|---| | Version | 0.1 (research preview), released 2026-09-29, HF tag `v0.1` | | Architecture | Cross-encoder (BERT/MiniLM, 6 layers, hidden 384, 12 heads) + 1-logit head | | Parameters | 22.7M | | Base model | [`sdmlai/nano-jev`](https://huggingface.co/sdmlai/nano-jev) v0.1 (itself from `cross-encoder/ms-marco-MiniLM-L6-v2`) | | Max input length | 256 tokens (the input is cut, never the question) | | Training data | 50,040 examples (data v5): http_attack 24,550 · prompt_injection 15,490 · phishing_url 10,000; seed 0 | | Training | 4 epochs run, best epoch 2 by dev NLL; batch 16 examples, AdamW lr 3e-5, weight decay 0.01, 6% warmup, linear decay, bf16 | | Hardware / time | 1× NVIDIA RTX 3060 12 GB, ~3.6 min per epoch | | Files | `model.safetensors` (PyTorch), `model.int8.onnx` (CPU), calibration JSONs, tokenizer | | Schema version | 0.1 (`cyberjev_config.json`) | ## How it works ``` [CLS] question: option: