SeaWolf-AI commited on
Commit
9d82878
·
verified ·
1 Parent(s): 62ca98d

eval_results: describe the actual GPQA protocol (not single-sample Pass@1)

Browse files
Files changed (1) hide show
  1. .eval_results/gpqa_diamond.yaml +1 -1
.eval_results/gpqa_diamond.yaml CHANGED
@@ -6,4 +6,4 @@
6
  source:
7
  url: https://huggingface.co/FINAL-Bench/Darwin-218B-Delphi
8
  name: Model Card
9
- notes: "MAJ@8 + MAJ@16 (tie-break), Darwin-DELPHI serving, Pass@1"
 
6
  source:
7
  url: https://huggingface.co/FINAL-Bench/Darwin-218B-Delphi
8
  name: Model Card
9
+ notes: "MAJ@8 with MAJ@16 tie-break, Darwin-DELPHI serving. Not a single-sample Pass@1 score."