nexa / bin /eval.py

Commit History

check: the eval rows re-measured on the subjects left, and checked
3ac608a

DBax127 commited on

readme: the 49/57 in the core sample table is OpenSPP's
facddfd

DBax127 commited on

narrow: one corpus, and it is Odoo
8d155aa

DBax127 Claude Opus 5 commited on

tidy: the counts the corpus outgrew, and a test CI would have failed
2411fdd

DBax127 Claude Opus 5 commited on

fieldtest: somebody else already decided, and a claim that was not true
67ef290

DBax127 Claude Opus 5 commited on

recall: cluster the misses, and check every version claim
1a32a1e

DBax127 Claude Opus 5 commited on

check: read the file, instead of only asking a model about it
521bc95

DBax127 Claude Opus 5 commited on

eval: measure nexa check, and none of the 25 reviews passed
ed1ef29

DBax127 Claude Opus 5 commited on

python: a fourth stack, so a plain .py file gets a real answer
87ca90f

DBax127 Claude Opus 5 commited on

eval: measure whether a rule can be retrieved, instead of inferring it
3f910c1

DBax127 Claude Opus 5 commited on

eval: measure verdict distribution over repeated runs
d0445b5

DBax127 Claude Opus 5 commited on