nielsr HF Staff commited on
Commit
d8506f5
·
verified ·
1 Parent(s): 8d1dda5

Add community evaluation results for AIME_2026, APEX-AGENTS, GPQA, HLE, MMLU-PRO, SWE-BENCH_VERIFIED

Browse files

This PR adds community-provided evaluation results for the following benchmarks:

- **[AIME_2026](https://huggingface.co/datasets/MathArena/aime_2026)**
- **[APEX-AGENTS](https://huggingface.co/datasets/mercor/apex-agents)**
- **[GPQA](https://huggingface.co/datasets/Idavidrein/gpqa)**
- **[HLE](https://huggingface.co/datasets/cais/hle)**
- **[MMLU-PRO](https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro)**
- **[SWE-BENCH_VERIFIED](https://huggingface.co/datasets/SWE-bench/SWE-bench_Verified)**

These results were extracted from the model card. This is based on the new [evaluation results feature](https://huggingface.co/docs/hub/eval-results).

*Note: This is an automated PR. Please review the evaluation results before merging.*

.eval_results/aime_2026.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: MathArena/aime_2026
3
+ task_id: MathArena/aime_2026
4
+ value: 95.7
5
+ source:
6
+ url: https://huggingface.co/upstage/Solar-Open2-250B
7
+ name: Model Card
.eval_results/apex-agents.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mercor/apex-agents
3
+ task_id: apex-agents
4
+ value: 16.6
5
+ source:
6
+ url: https://huggingface.co/upstage/Solar-Open2-250B
7
+ name: Model Card
.eval_results/gpqa.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: Idavidrein/gpqa
3
+ task_id: diamond
4
+ value: 86.3
5
+ source:
6
+ url: https://huggingface.co/upstage/Solar-Open2-250B
7
+ name: Model Card
.eval_results/hle.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: cais/hle
3
+ task_id: hle
4
+ value: 28.8
5
+ source:
6
+ url: https://huggingface.co/upstage/Solar-Open2-250B
7
+ name: Model Card
.eval_results/mmlu-pro.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: TIGER-Lab/MMLU-Pro
3
+ task_id: mmlu_pro
4
+ value: 86.2
5
+ source:
6
+ url: https://huggingface.co/upstage/Solar-Open2-250B
7
+ name: Model Card
.eval_results/swe-bench_verified.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: SWE-bench/SWE-bench_Verified
3
+ task_id: swe_bench_%_resolved
4
+ value: 70.4
5
+ source:
6
+ url: https://huggingface.co/upstage/Solar-Open2-250B
7
+ name: Model Card