sidchalamala commited on
Commit
bfb1e7f
·
verified ·
1 Parent(s): c32badc

Model card: round held-out v1 intervals to 2 decimals (numbers unchanged)

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -19,9 +19,9 @@ Each task asks for something the policy forbids or Aether cannot do. The correct
19
 
20
  | System | Correct | 95% CI |
21
  |---|---|---|
22
- | Base model + reference card + 3 examples | 0/30 | 0.0-0.114 |
23
- | v0.1 (synthetic data only) | 6/30 | 0.095-0.373 |
24
- | **v0.2 (this adapter: + 413 trap samples)** | **6/30** | 0.095-0.373 |
25
 
26
  - **Negative result:** adding 413 targeted trap samples did **not** improve held-out performance. v0.2 vs v0.1: 6 vs 6, paired exact McNemar p = 1.
27
  - v0.2 vs the base model: p = 0.031.
 
19
 
20
  | System | Correct | 95% CI |
21
  |---|---|---|
22
+ | Base model + reference card + 3 examples | 0/30 | 0.00-0.11 |
23
+ | v0.1 (synthetic data only) | 6/30 | 0.10-0.37 |
24
+ | **v0.2 (this adapter: + 413 trap samples)** | **6/30** | 0.10-0.37 |
25
 
26
  - **Negative result:** adding 413 targeted trap samples did **not** improve held-out performance. v0.2 vs v0.1: 6 vs 6, paired exact McNemar p = 1.
27
  - v0.2 vs the base model: p = 0.031.