- Scorer adapter interface + LocalScorer (judge mode plugs in later)
- taxonomy: task type -> research-grounded parameters with default weights
- parameter evaluators with quoted evidence and honesty flags
- flagship generator: failure mode x task x model family, complete
paste-ready replacement prompts, no-generic-advice contract under test
- FastAPI app (/evaluate, /health, /warmup)
- curated planted-failure test pairs; classifier/constraint/regex fixes
found by the suite; question coverage reframed as honest topical proxy
after empirical probe showed bi-encoders cannot detect answerhood
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
