Fetching metadata from the HF Docker repository...
-
Implement validation pipeline fixes (P1-P7) and experimental track system
bshepp
Pipeline fixes:
- P1: Question type classifier (question_classifier.py) - 9 types via heuristic regex
- P3: Preserve question stem - _extract_vignette -> _split_question returning (vignette, stem)
- P4: Type-aware scoring - score_case() dispatcher with per-type scorers (diagnostic, treatment, mechanism, lab_finding, generic)
- P5: Improved fuzzy matching - recall-based with medical stopwords, 3-strategy approach
- P6: MCQ answer selection - select_mcq_answer() uses MedGemma to pick A/B/C/D given CDS report
- P7: Stratified reporting - per-type breakdown table + pipeline-appropriate subset metrics
Experimental track system:
- CLAUDE.md, TRACKS.md, EXPERIMENT_PLAN.md - project intelligence and track registry
- Track A: Baseline pipeline tagged (all app/ files)
- Track B: RAG variants (10 configs, chunking/embedding experiments)
- Track C: Iterative refinement (4 configs, serial refinement rounds)
- Track D: Arbitrated parallel (4 configs, specialist + arbiter pattern)
- Shared utilities…
