ArkidMitra commited on
Commit
839fc2c
·
verified ·
1 Parent(s): 326e3fb

Card: remove selection/provenance process detail; keep results, cost, usage

Browse files
Files changed (1) hide show
  1. README.md +5 -9
README.md CHANGED
@@ -33,8 +33,7 @@ Duo picks per query. On a mixed workload it beats **both** constituents.
33
  ## Results
34
 
35
  MAP@10, full corpus, all ground-truth queries, one evaluator (`pytrec_eval map_cut.10`),
36
- paired bootstrap 10,000 resamples. Routing policy frozen on development data before any
37
- benchmark was scored.
38
 
39
  | benchmark | MODA | MODA Pro Lite+ | **MODA Duo** |
40
  |---|---:|---:|---:|
@@ -86,14 +85,11 @@ The router is a callable — replace it with any policy that maps a query to a c
86
  duo = Duo(router=lambda q: "moda" if looks_like_a_description(q) else "moda_pro_lite_plus")
87
  ```
88
 
89
- ## Selection and provenance
90
 
91
- - Constituents: MODA and MODA Pro Lite+, each with its own published harness, unchanged.
92
- - The routing policy was chosen on OpenVTON validation and GLAMI development data by
93
- minimising worst-regime regret against the per-regime oracle, frozen, then applied once to
94
- the benchmarks above. No benchmark was consulted during selection.
95
- - Full receipts, per-query results, and the sensitivity curve are in the
96
- [repository](https://github.com/hopit-ai/Moda).
97
 
98
  ## Related
99
 
 
33
  ## Results
34
 
35
  MAP@10, full corpus, all ground-truth queries, one evaluator (`pytrec_eval map_cut.10`),
36
+ paired bootstrap 10,000 resamples.
 
37
 
38
  | benchmark | MODA | MODA Pro Lite+ | **MODA Duo** |
39
  |---|---:|---:|---:|
 
85
  duo = Duo(router=lambda q: "moda" if looks_like_a_description(q) else "moda_pro_lite_plus")
86
  ```
87
 
88
+ ## Evaluation
89
 
90
+ All figures are full corpus, all ground-truth queries, MAP@10 under one evaluator
91
+ (`pytrec_eval map_cut.10`), paired bootstrap with 10,000 resamples. Per-query results are in
92
+ the [repository](https://github.com/hopit-ai/Moda).
 
 
 
93
 
94
  ## Related
95