dlab-spp/airisk_dilemmas
Viewer • Updated • 20.8k • 59
ConstitutionEval (in-domain constitution following) and audited AIRiskDilemmas (out-of-distribution value prioritisation and risk-taking).
Note Audited AIRiskDilemmas (Chiu et al. 2025) — every `risky_behaviors` label manually re-checked. Out-of-distribution moral dilemmas used to measure value prioritisation (Elo over 16 value axes) and safe-choice rate.
Note **ConstitutionEval** — in-domain benchmark for constitution following. Each item gives four responses to a scenario, exactly one of which complies with the constitution. Includes the harder ConstitutionEval-Hard band.