Instructions to use sentinelsage/arbiter-log-classifier with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use sentinelsage/arbiter-log-classifier with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="sentinelsage/arbiter-log-classifier")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("sentinelsage/arbiter-log-classifier") model = AutoModelForSequenceClassification.from_pretrained("sentinelsage/arbiter-log-classifier", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -5,15 +5,15 @@ tags:
|
|
| 5 |
- distilbert
|
| 6 |
- text-classification
|
| 7 |
- security
|
| 8 |
-
-
|
| 9 |
pipeline_tag: text-classification
|
| 10 |
---
|
| 11 |
|
| 12 |
-
#
|
| 13 |
|
| 14 |
## What this is
|
| 15 |
|
| 16 |
-
A **DistilBERT** sequence-classification checkpoint fine-tuned for
|
| 17 |
|
| 18 |
Given a short security-log style string, it predicts one of four actions:
|
| 19 |
|
|
@@ -24,39 +24,58 @@ Given a short security-log style string, it predicts one of four actions:
|
|
| 24 |
| 2 | warn |
|
| 25 |
| 3 | none |
|
| 26 |
|
| 27 |
-
The
|
| 28 |
|
| 29 |
## Project
|
| 30 |
|
| 31 |
-
Part of **
|
| 32 |
|
| 33 |
-
This repository holds **weights only**. Application code
|
| 34 |
|
| 35 |
## Training note
|
| 36 |
|
| 37 |
This is a **custom fine-tune**, not an unmodified public DistilBERT base checkpoint. Do not treat Hub `distilbert-base-uncased` (or similar) as a drop-in substitute for this artifact.
|
| 38 |
|
|
|
|
|
|
|
| 39 |
## Intended use
|
| 40 |
|
| 41 |
-
- Running the
|
| 42 |
- Experimentation and educational use with the companion application
|
| 43 |
|
| 44 |
**Not** a production SOC product. No warranty. Outputs can be wrong; do not use for live blocking, compliance, or incident response without your own validation.
|
| 45 |
|
| 46 |
-
## How
|
| 47 |
|
| 48 |
-
Local path after download:
|
| 49 |
|
| 50 |
```text
|
| 51 |
backend/models/log_based_model/
|
| 52 |
```
|
| 53 |
|
| 54 |
-
Loaded with Hugging Face `DistilBertForSequenceClassification.from_pretrained(<local_or_hub_id>)` when `
|
| 55 |
|
| 56 |
## Files
|
| 57 |
|
| 58 |
Expect a standard Transformers export, e.g. `model.safetensors`, `config.json`, tokenizer files (`vocab.txt`, `tokenizer_config.json`, …).
|
| 59 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 60 |
## License
|
| 61 |
|
| 62 |
Apache License 2.0. Demo only — provided as-is, without warranty of any kind.
|
|
|
|
|
|
|
|
|
| 5 |
- distilbert
|
| 6 |
- text-classification
|
| 7 |
- security
|
| 8 |
+
- arbiter
|
| 9 |
pipeline_tag: text-classification
|
| 10 |
---
|
| 11 |
|
| 12 |
+
# Arbiter — Log threat classifier
|
| 13 |
|
| 14 |
## What this is
|
| 15 |
|
| 16 |
+
A **DistilBERT** sequence-classification checkpoint fine-tuned for **[Arbiter](https://github.com/SentinelSage/arbiter)**.
|
| 17 |
|
| 18 |
Given a short security-log style string, it predicts one of four actions:
|
| 19 |
|
|
|
|
| 24 |
| 2 | warn |
|
| 25 |
| 3 | none |
|
| 26 |
|
| 27 |
+
The Arbiter app then scales a threat score from the predicted class / probabilities and may adjust the final recommendation with a separate rule-based layer (`refine_action`).
|
| 28 |
|
| 29 |
## Project
|
| 30 |
|
| 31 |
+
Part of **Arbiter** (Django + React): paste a security log or ask a cybersecurity question.
|
| 32 |
|
| 33 |
+
This repository holds **weights only**. Application code: [github.com/SentinelSage/arbiter](https://github.com/SentinelSage/arbiter).
|
| 34 |
|
| 35 |
## Training note
|
| 36 |
|
| 37 |
This is a **custom fine-tune**, not an unmodified public DistilBERT base checkpoint. Do not treat Hub `distilbert-base-uncased` (or similar) as a drop-in substitute for this artifact.
|
| 38 |
|
| 39 |
+
**Training data:** custom-curated, **unpublished** project data. There is no public labelled cybersecurity corpus linked as a training set for this demo.
|
| 40 |
+
|
| 41 |
## Intended use
|
| 42 |
|
| 43 |
+
- Running the Arbiter full-ML path locally
|
| 44 |
- Experimentation and educational use with the companion application
|
| 45 |
|
| 46 |
**Not** a production SOC product. No warranty. Outputs can be wrong; do not use for live blocking, compliance, or incident response without your own validation.
|
| 47 |
|
| 48 |
+
## How Arbiter loads it
|
| 49 |
|
| 50 |
+
Local path after download (`scripts/download_models.py` or equivalent):
|
| 51 |
|
| 52 |
```text
|
| 53 |
backend/models/log_based_model/
|
| 54 |
```
|
| 55 |
|
| 56 |
+
Loaded with Hugging Face `DistilBertForSequenceClassification.from_pretrained(<local_or_hub_id>)` when `ARBITER_DEMO_MODE=false`.
|
| 57 |
|
| 58 |
## Files
|
| 59 |
|
| 60 |
Expect a standard Transformers export, e.g. `model.safetensors`, `config.json`, tokenizer files (`vocab.txt`, `tokenizer_config.json`, …).
|
| 61 |
|
| 62 |
+
## Method / citations
|
| 63 |
+
|
| 64 |
+
If you reference this work:
|
| 65 |
+
|
| 66 |
+
- **DistilBERT:** Sanh, V., Debut, L., Chaumond, J., & Wolf, T. (2019). *DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter.*
|
| 67 |
+
Base: [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased)
|
| 68 |
+
- **Transformers:** Wolf, T., et al. (2020). *Transformers: State-of-the-Art Natural Language Processing.* EMNLP.
|
| 69 |
+
[huggingface/transformers](https://github.com/huggingface/transformers)
|
| 70 |
+
- **PyTorch:** Paszke, A., et al. (2019). *PyTorch: An Imperative Style, High-Performance Deep Learning Library.* NeurIPS.
|
| 71 |
+
[pytorch/pytorch](https://github.com/pytorch/pytorch)
|
| 72 |
+
|
| 73 |
+
## Safety
|
| 74 |
+
|
| 75 |
+
Research / portfolio demo only. Classifier confidence is **not calibrated**. Do not paste production logs, PII, or credentials into demos that use these weights on a shared host.
|
| 76 |
+
|
| 77 |
## License
|
| 78 |
|
| 79 |
Apache License 2.0. Demo only — provided as-is, without warranty of any kind.
|
| 80 |
+
|
| 81 |
+
Copyright 2026 Ryan Vong / Sentinel Sage
|