Add community evaluation results for Humanity's Last Exam, MMLU-Pro, AIME 2026, GPQA Diamond

#48
by nielsr HF Staff - opened

YAML Metadata Error:Invalid content in Eval Result file .eval_results/hle.yaml

Check out the documentation for more information.

Show details
Task ID "hle" does not match any task in dataset "cais/hle". Available: none
.eval_results/aime_2026.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: MathArena/aime_2026
3
+ task_id: MathArena/aime_2026
4
+ value: 94.2
5
+ source:
6
+ url: https://arxiv.org/abs/2605.26494
7
+ name: Paper (Table 4)
.eval_results/gpqa.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: Idavidrein/gpqa
3
+ task_id: diamond
4
+ value: 89.8
5
+ source:
6
+ url: https://arxiv.org/abs/2605.26494
7
+ name: Paper (Table 4)
.eval_results/hle.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: cais/hle
3
+ task_id: hle
4
+ value: 28.0
5
+ source:
6
+ url: https://arxiv.org/abs/2605.26494
7
+ name: Paper (Table 4)
.eval_results/mmlu-pro.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: TIGER-Lab/MMLU-Pro
3
+ task_id: mmlu_pro
4
+ value: 81.8
5
+ source:
6
+ url: https://arxiv.org/abs/2605.26494
7
+ name: Paper (Table 4)