Gold-standard hardening: calibration, new solvers, property tests, CI gates
Paul Clark+1: Claude Fable 5
77ec8ec
Confidence calibration (the honesty flagship):
- The heuristic emitted hand-tuned confidences that were badly miscalibrated —
a raw 26% meant ~4% real accuracy, a raw 86% meant ~97%. calibrate_confidence()
applies an isotonic map (fit on validation by scripts/calibrate_confidence.py)
inside heuristic_classify, cutting expected calibration error from 0.18 to
0.04 on the held-out test split. A reported N% now means right ~N% of the time.
Two new auto-solvers + a dictionary pass:
- beaufort_auto_solve (reciprocal Vigenere, same coordinate-descent refinement)
- columnar_auto_solve (recovers column ORDER by hill-climbing the quadgram
score; key letters are irrelevant)
- Vigenere keyword-dictionary pass for short texts. Benchmarked with keys NOT
in the dictionary so the reported statistical rates are honest.
Property-based tests (tests/test_properties.py, hypothesis):
- decode(encode(x))==x, reciprocity, and generator/core agreement across all
reversible ciphers — the class o…
ci: remove auto-sync to deleted training Space
Paul Clark
79d5717
ci: also sync training_space/ to HF training Space on push
Paul Clark
735a87c
ci: bump actions/checkout to v5 and setup-python to v6 for Node 24
Paul Clark
96a22cf
ci: install runtime deps alongside dev deps so sklearn is available in tests
Paul Clark
0fbf13f
ci: add GitHub Actions workflow to auto-sync to HF Space
