Jailbreak Detection Model 🚀

This model is fine-tuned to detect jailbreak prompts / unsafe instructions.

📊 Training Metrics

Training steps: 0
Final Training Loss: N/A
Final Eval Loss: 0.07551019638776779

📈 Training Curve

🛠 How to Use

from transformers import AutoModelForSequenceClassification, AutoTokenizer

model = AutoModelForSequenceClassification.from_pretrained("hurtmongoose/Jailbreak-Detection-Models")
tokenizer = AutoTokenizer.from_pretrained("hurtmongoose/Jailbreak-Detection-Models")

inputs = tokenizer("This is a test jailbreak prompt", return_tensors="pt")
outputs = model(**inputs)
print(outputs.logits)
📌 Notes

Trained on jailbreak detection dataset

Can be improved with more adversarial prompts