purvansh01/safetypulse-probe-bundle
Updated • 46
SafetyPulse (Lexsi hackathon, Track 2b): eval splits, fine-tune data, contrast pairs, probe bundle, monitoring and audit logs.
Note What safetypulse check needs: refusal direction, 20-component circuit, probe pairs, thresholds.
Note CIS, spot-check and ASR for 150 checkpoints; audits (harmful answers withheld); repair and report tables.
Note Fixed dev/test splits: HarmBench, XSTest, GSM8K, MMLU.
Note Alpaca, CuratorKIT-curated Alpaca, GSM8K and negative-control fine-tuning sets.
Note 288 matched harmful / harmless contrast pairs.