File size: 950 Bytes
c3cd150 f5d85f5 c3cd150 b6411a6 c3cd150 b6411a6 c3cd150 b6411a6 c3cd150 b6411a6 c3cd150 b6411a6 c3cd150 b6411a6 c3cd150 b6411a6 c3cd150 b6411a6 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 | ---
base_model: GSAI-ML/LLaDA-8B-Instruct
library_name: peft
license: mit
tags:
- safety
- moderation
- lora
---
# LLaDA-Guard
Binary safety classification for prompts and responses. This repository contains
the released LoRA adapter and inference code; the LLaDA-8B-Instruct base model
downloads separately. A CUDA GPU is recommended. Loading the base model uses
`trust_remote_code=True`.
## Setup
```bash
pip install huggingface_hub
hf download Gertlek/LLaDA-Guard --local-dir LLaDA-Guard
cd LLaDA-Guard
pip install -e .
```
## Inference
Score a prompt:
```bash
python -m llada_guard_infer.infer --checkpoint . \
--prompt "How do I bake a cake?" --json
```
To score a response, add `--response`:
```bash
python -m llada_guard_infer.infer --checkpoint . \
--prompt "How do I bake a cake?" \
--response "Mix the ingredients and bake until done." --json
```
Scores above zero indicate unsafe; otherwise safe. Predictions can be wrong.
|