Text Classification
Transformers
Safetensors
roberta
codebert
cybersecurity
vulnerability-detection
code
security
text-embeddings-inference
Instructions to use MhamedRayan/devsecops-transformer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use MhamedRayan/devsecops-transformer with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="MhamedRayan/devsecops-transformer")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("MhamedRayan/devsecops-transformer") model = AutoModelForSequenceClassification.from_pretrained("MhamedRayan/devsecops-transformer", device_map="auto") - Notebooks
- Google Colab
- Kaggle
|
Download README.md from MhamedRayan/devsecops-transformer: direct link, hf CLI and curl.
- Browser
- Download file 2.9 kB
-
https://huggingface.co/MhamedRayan/devsecops-transformer/resolve/main/README.md
- Command line
-
hf download hf://MhamedRayan/devsecops-transformer/README.md
-
curl -L -o README.md https://huggingface.co/MhamedRayan/devsecops-transformer/resolve/main/README.md
2.9 kB
metadata
license: other
library_name: transformers
pipeline_tag: text-classification
base_model: microsoft/codebert-base
tags:
- codebert
- cybersecurity
- vulnerability-detection
- code
- security
- text-classification
Agent 2 — CodeBERT Vulnerability Classifier
CodeBERT-base fine-tuned to flag vulnerabilities in C/C++ source code. Part of a three-agent DevSecOps auditor (metrics → transformer → gatekeeper).
Model details
| Field | Value |
|---|---|
| Version | 1.0.0 (initial release) |
| Base model | microsoft/codebert-base |
| Architecture | RobertaForSequenceClassification |
| Task | Binary text classification |
| Labels | SAFE (0), VULNERABLE (1) |
| Max length | 384 tokens |
| Threshold | 0.45 |
| Training data | CodeXGLUE defect detection + DiverseVul (C/C++) |
| Dataset version | Not pinned — local snapshots, revisions not recorded |
Files
| File | Purpose |
|---|---|
config.json |
Architecture; label2id = {"SAFE": 0, "VULNERABLE": 1} |
model.safetensors |
Fine-tuned weights (~476 MB) |
tokenizer.json |
Fast tokenizer |
tokenizer_config.json |
Tokenizer settings |
meta.json |
Extra wrapper metadata (threshold, max length, metrics) |
meta.json is not used by transformers; the values are repeated here.
Input and preprocessing
- Input: one raw source-code string. No manual feature extraction.
- Feature ordering: N/A — the tokenizer produces the input IDs and attention mask.
- Tokenize with
truncation=True, max_length=384. Longer code is truncated, so only the first 384 tokens affect the score. - Labels are taken from
config.json(label2id).
Output
Raw: logits of shape (1, 2); apply softmax and read index 1:
p_vuln = softmax(logits, dim=-1)[0, model.config.label2id["VULNERABLE"]].item()
vulnerable = p_vuln >= 0.45
Reference wrapper output:
{"transformer_risk_score": 0.3013, "vulnerable": false, "threshold": 0.45, "status": "ok", "reason": ""}
Scores are softmax outputs, not calibrated probabilities. Recall is prioritized over precision, so false positives are expected. Non-C/C++ code is out-of-distribution.
Metrics
| Metric | Value |
|---|---|
| F1 | 0.6881 |
| Precision | 0.5804 |
| Recall | 0.8450 |
| ROC-AUC | 0.7475 |
Usage
import torch
from transformers import AutoModelForSequenceClassification, AutoTokenizer
name = "your-username/agent2-codebert-vuln"
tok = AutoTokenizer.from_pretrained(name)
model = AutoModelForSequenceClassification.from_pretrained(name).eval()
inputs = tok(code, return_tensors="pt", truncation=True, max_length=384)
with torch.inference_mode():
logits = model(**inputs).logits
p_vuln = torch.softmax(logits, -1)[0, model.config.label2id["VULNERABLE"]].item()
vulnerable = p_vuln >= 0.45
License
Not specified. Update the license field before publishing.