Text Classification
Transformers
Safetensors
roberta
codebert
cybersecurity
vulnerability-detection
code
security
text-embeddings-inference
Instructions to use MhamedRayan/devsecops-transformer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use MhamedRayan/devsecops-transformer with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="MhamedRayan/devsecops-transformer")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("MhamedRayan/devsecops-transformer") model = AutoModelForSequenceClassification.from_pretrained("MhamedRayan/devsecops-transformer", device_map="auto") - Notebooks
- Google Colab
- Kaggle
|
Download README.md from MhamedRayan/devsecops-transformer: direct link, hf CLI and curl.
- Browser
- Download file 2.9 kB
-
https://huggingface.co/MhamedRayan/devsecops-transformer/resolve/main/README.md
- Command line
-
hf download hf://MhamedRayan/devsecops-transformer/README.md
-
curl -L -o README.md https://huggingface.co/MhamedRayan/devsecops-transformer/resolve/main/README.md
2.9 kB
| license: other | |
| library_name: transformers | |
| pipeline_tag: text-classification | |
| base_model: microsoft/codebert-base | |
| tags: | |
| - codebert | |
| - cybersecurity | |
| - vulnerability-detection | |
| - code | |
| - security | |
| - text-classification | |
| # Agent 2 — CodeBERT Vulnerability Classifier | |
| CodeBERT-base fine-tuned to flag vulnerabilities in C/C++ source code. | |
| Part of a three-agent DevSecOps auditor (metrics → transformer → gatekeeper). | |
| ## Model details | |
| | Field | Value | | |
| |---|---| | |
| | Version | 1.0.0 (initial release) | | |
| | Base model | `microsoft/codebert-base` | | |
| | Architecture | `RobertaForSequenceClassification` | | |
| | Task | Binary text classification | | |
| | Labels | `SAFE` (0), `VULNERABLE` (1) | | |
| | Max length | **384** tokens | | |
| | Threshold | **0.45** | | |
| | Training data | CodeXGLUE defect detection + DiverseVul (C/C++) | | |
| | Dataset version | Not pinned — local snapshots, revisions not recorded | | |
| ## Files | |
| | File | Purpose | | |
| |---|---| | |
| | `config.json` | Architecture; `label2id` = `{"SAFE": 0, "VULNERABLE": 1}` | | |
| | `model.safetensors` | Fine-tuned weights (~476 MB) | | |
| | `tokenizer.json` | Fast tokenizer | | |
| | `tokenizer_config.json` | Tokenizer settings | | |
| | `meta.json` | Extra wrapper metadata (threshold, max length, metrics) | | |
| `meta.json` is not used by `transformers`; the values are repeated here. | |
| ## Input and preprocessing | |
| - Input: one raw source-code string. No manual feature extraction. | |
| - Feature ordering: **N/A** — the tokenizer produces the input IDs and | |
| attention mask. | |
| - Tokenize with `truncation=True, max_length=384`. Longer code is truncated, | |
| so only the first 384 tokens affect the score. | |
| - Labels are taken from `config.json` (`label2id`). | |
| ## Output | |
| Raw: logits of shape `(1, 2)`; apply softmax and read index 1: | |
| ```python | |
| p_vuln = softmax(logits, dim=-1)[0, model.config.label2id["VULNERABLE"]].item() | |
| vulnerable = p_vuln >= 0.45 | |
| ``` | |
| Reference wrapper output: | |
| ```json | |
| {"transformer_risk_score": 0.3013, "vulnerable": false, "threshold": 0.45, "status": "ok", "reason": ""} | |
| ``` | |
| Scores are softmax outputs, not calibrated probabilities. Recall is prioritized | |
| over precision, so false positives are expected. Non-C/C++ code is | |
| out-of-distribution. | |
| ## Metrics | |
| | Metric | Value | | |
| |---|---| | |
| | F1 | 0.6881 | | |
| | Precision | 0.5804 | | |
| | Recall | 0.8450 | | |
| | ROC-AUC | 0.7475 | | |
| ## Usage | |
| ```python | |
| import torch | |
| from transformers import AutoModelForSequenceClassification, AutoTokenizer | |
| name = "your-username/agent2-codebert-vuln" | |
| tok = AutoTokenizer.from_pretrained(name) | |
| model = AutoModelForSequenceClassification.from_pretrained(name).eval() | |
| inputs = tok(code, return_tensors="pt", truncation=True, max_length=384) | |
| with torch.inference_mode(): | |
| logits = model(**inputs).logits | |
| p_vuln = torch.softmax(logits, -1)[0, model.config.label2id["VULNERABLE"]].item() | |
| vulnerable = p_vuln >= 0.45 | |
| ``` | |
| ## License | |
| Not specified. Update the `license` field before publishing. | |