SeaWolf-AI commited on
Commit
c05c0ba
·
verified ·
1 Parent(s): d188dce

eval_results: describe the actual GPQA protocol (not single-sample Pass@1)

Browse files
Files changed (1) hide show
  1. .eval_results/gpqa_diamond.yaml +1 -1
.eval_results/gpqa_diamond.yaml CHANGED
@@ -6,4 +6,4 @@
6
  source:
7
  url: https://huggingface.co/FINAL-Bench/Darwin-9B-NEG
8
  name: Model Card
9
- notes: "9B class, standard inference, Pass@1"
 
6
  source:
7
  url: https://huggingface.co/FINAL-Bench/Darwin-9B-NEG
8
  name: Model Card
9
+ notes: "NEG + choice-order permutation + temperature-sampled ensemble (about 20x compute). Greedy single pass with NEG: 63.64%. Not a single-sample Pass@1 score."