Add model card
Browse files
README.md
ADDED
|
@@ -0,0 +1,56 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
base_model: microsoft/codebert-base
|
| 3 |
+
library_name: pytorch
|
| 4 |
+
tags:
|
| 5 |
+
- security
|
| 6 |
+
- command-analysis
|
| 7 |
+
- malware-detection
|
| 8 |
+
- tf-idf
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# Genos model weights
|
| 12 |
+
|
| 13 |
+
Runtime model artifacts for the Genos command-analysis API (`genos_api`).
|
| 14 |
+
|
| 15 |
+
## Files
|
| 16 |
+
|
| 17 |
+
| File | Format | Purpose |
|
| 18 |
+
|---|---|---|
|
| 19 |
+
| `gatekeeper.pt` | PyTorch (CodeBERT fine-tune) | Tier 1 three-class gatekeeper: Benign / Context_Dependent / Malicious |
|
| 20 |
+
| `behavior_encoder.pt`, `behavior_encoder.json` | PyTorch (CodeBERT fine-tune) + config | Behavior encoder: 13 attack stages and 9 action tags, `max_length` 256 |
|
| 21 |
+
| `family_specialist_tfidf.joblib` | joblib (scikit-learn) | Tier 2 specialist: calibrated multi-label 11-family TF-IDF linear classifier |
|
| 22 |
+
| `family_specialist_tfidf.json` | JSON | Training configuration and feature/calibration metadata for the Tier 2 specialist |
|
| 23 |
+
|
| 24 |
+
The CodeBERT backbone used by the Tier 1 gatekeeper is not included. Fetch it
|
| 25 |
+
separately from [`microsoft/codebert-base`](https://huggingface.co/microsoft/codebert-base).
|
| 26 |
+
|
| 27 |
+
## Usage
|
| 28 |
+
|
| 29 |
+
Download into the repository's `models/` directory, which is where the
|
| 30 |
+
application expects these files:
|
| 31 |
+
|
| 32 |
+
```bash
|
| 33 |
+
hf download genos-security/genos --local-dir models
|
| 34 |
+
hf download microsoft/codebert-base --local-dir models/codebert-base
|
| 35 |
+
```
|
| 36 |
+
|
| 37 |
+
## Security note
|
| 38 |
+
|
| 39 |
+
The `.pt` and `.joblib` formats are Python pickles. Loading them runs code
|
| 40 |
+
embedded in the file. Load these artifacts only from sources you trust, and
|
| 41 |
+
verify checksums before deploying.
|
| 42 |
+
|
| 43 |
+
## Intended use
|
| 44 |
+
|
| 45 |
+
Defensive analysis and research on suspicious shell and script commands. These
|
| 46 |
+
models are classifiers and should be used as one signal, not as a sole basis for
|
| 47 |
+
blocking or attributing activity.
|
| 48 |
+
|
| 49 |
+
## Limitations
|
| 50 |
+
|
| 51 |
+
- Training labels are weak supervision. Independent human review of the labels is
|
| 52 |
+
not complete.
|
| 53 |
+
- Scores are uncalibrated model estimates unless a validation-fitted calibration
|
| 54 |
+
artifact is supplied.
|
| 55 |
+
- The TF-IDF artifact stores vocabulary built from training commands, so it may
|
| 56 |
+
contain fragments of that data.
|