Spaces:
Running
Running
Add MoveBench Release 1 leaderboard
Browse files- .gitattributes +1 -0
- README.md +18 -4
- domain_scores.png +3 -0
- index.html +49 -18
.gitattributes
CHANGED
|
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
domain_scores.png filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -1,10 +1,24 @@
|
|
| 1 |
---
|
| 2 |
title: MoveBench Leaderboard
|
| 3 |
-
emoji:
|
| 4 |
-
colorFrom:
|
| 5 |
-
colorTo:
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
---
|
| 9 |
|
| 10 |
-
|
|
|
|
| 1 |
---
|
| 2 |
title: MoveBench Leaderboard
|
| 3 |
+
emoji: 🏃
|
| 4 |
+
colorFrom: blue
|
| 5 |
+
colorTo: green
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
| 8 |
+
license: cc-by-4.0
|
| 9 |
+
short_description: Sports and health coaching benchmark leaderboard
|
| 10 |
+
models:
|
| 11 |
+
- zai-org/GLM-5.3
|
| 12 |
+
- moonshotai/Kimi-K3
|
| 13 |
+
- MiniMaxAI/MiniMax-M3
|
| 14 |
+
- tencent/Hy3
|
| 15 |
+
datasets:
|
| 16 |
+
- KeepaceAI/MoveBench
|
| 17 |
+
tags:
|
| 18 |
+
- leaderboard
|
| 19 |
+
- benchmark
|
| 20 |
+
- sports
|
| 21 |
+
- health
|
| 22 |
---
|
| 23 |
|
| 24 |
+
Leaderboard for [MoveBench](https://huggingface.co/datasets/KeepaceAI/MoveBench) Release 1 (80 public questions).
|
domain_scores.png
ADDED
|
Git LFS Details
|
index.html
CHANGED
|
@@ -1,19 +1,50 @@
|
|
| 1 |
<!doctype html>
|
| 2 |
-
<html>
|
| 3 |
-
|
| 4 |
-
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
| 9 |
-
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
</
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
<!doctype html>
|
| 2 |
+
<html lang="en"><head><meta charset="utf-8"><meta name="viewport" content="width=device-width,initial-scale=1">
|
| 3 |
+
<title>MoveBench Leaderboard</title>
|
| 4 |
+
<style>
|
| 5 |
+
:root{--bg:#fcfcfb;--fg:#0b0b0b;--muted:#5f5e5a;--line:#e4e3de;--accent:#2a78d6}
|
| 6 |
+
@media (prefers-color-scheme:dark){:root{--bg:#1a1a19;--fg:#f0efec;--muted:#c3c2b7;--line:#3a3a37;--accent:#3987e5}}
|
| 7 |
+
body{margin:0;background:var(--bg);color:var(--fg);font:15px/1.55 system-ui,-apple-system,"PingFang SC",sans-serif}
|
| 8 |
+
main{max-width:960px;margin:0 auto;padding:32px 16px 48px}
|
| 9 |
+
h1{font-size:28px;margin:0 0 4px} .sub{color:var(--muted);margin:0 0 16px}
|
| 10 |
+
nav a{color:var(--accent);margin-right:14px;text-decoration:none}
|
| 11 |
+
.wrap{overflow-x:auto;margin:20px 0} table{border-collapse:collapse;width:100%;font-variant-numeric:tabular-nums}
|
| 12 |
+
th,td{padding:8px 10px;border-bottom:1px solid var(--line);text-align:right;white-space:nowrap}
|
| 13 |
+
th:nth-child(2),td:nth-child(2){text-align:left} th{color:var(--muted);font-weight:600;font-size:13px}
|
| 14 |
+
td a{color:var(--accent);text-decoration:none}
|
| 15 |
+
img{max-width:100%;border-radius:8px;border:1px solid var(--line)}
|
| 16 |
+
ul{padding-left:20px} li{margin:4px 0} .note{color:var(--muted);font-size:13px}
|
| 17 |
+
</style></head><body><main>
|
| 18 |
+
<h1>MoveBench Leaderboard</h1>
|
| 19 |
+
<p class="sub">Chinese sports and health coaching benchmark · Release 1 · 80 public questions</p>
|
| 20 |
+
<nav><a href="https://huggingface.co/datasets/KeepaceAI/MoveBench">Dataset</a><a href="https://arxiv.org/abs/2610.26185">Paper</a><a href="https://github.com/Keep-Tech/MoveBench">GitHub</a><a href="https://github.com/Keep-Tech/MoveBench/blob/main/docs/SUBMISSION.md">Submit a model</a></nav>
|
| 21 |
+
<div class="wrap"><table>
|
| 22 |
+
<thead><tr><th>Rank</th><th>Model</th><th>Overall</th><th>OQ (50)</th><th>MCQ (30)</th><th>PG</th><th>DA</th><th>QA</th></tr></thead>
|
| 23 |
+
<tbody>
|
| 24 |
+
<tr><td>1</td><td>Claude Opus 5.5</td><td><b>0.897</b></td><td>0.892</td><td>30/30</td><td>0.860</td><td>0.927</td><td>0.947</td></tr>
|
| 25 |
+
<tr><td>2</td><td>Qwen3.8-Max</td><td><b>0.886</b></td><td>0.880</td><td>30/30</td><td>0.839</td><td>0.932</td><td>0.938</td></tr>
|
| 26 |
+
<tr><td>3</td><td><a href="https://huggingface.co/zai-org/GLM-5.3">GLM-5.3</a></td><td><b>0.878</b></td><td>0.872</td><td>30/30</td><td>0.825</td><td>0.925</td><td>0.947</td></tr>
|
| 27 |
+
<tr><td>4</td><td><a href="https://huggingface.co/MiniMaxAI/MiniMax-M3">MiniMax-M3</a></td><td><b>0.864</b></td><td>0.859</td><td>29/30</td><td>0.803</td><td>0.911</td><td>0.949</td></tr>
|
| 28 |
+
<tr><td>5</td><td><a href="https://huggingface.co/moonshotai/Kimi-K3">Kimi-K3</a></td><td><b>0.860</b></td><td>0.853</td><td>30/30</td><td>0.804</td><td>0.904</td><td>0.936</td></tr>
|
| 29 |
+
<tr><td>6</td><td><a href="https://huggingface.co/tencent/Hy3">HY3</a></td><td><b>0.858</b></td><td>0.851</td><td>30/30</td><td>0.811</td><td>0.896</td><td>0.919</td></tr>
|
| 30 |
+
<tr><td>7</td><td>Doubao-Seed-2.1-Pro</td><td><b>0.857</b></td><td>0.850</td><td>30/30</td><td>0.803</td><td>0.904</td><td>0.925</td></tr>
|
| 31 |
+
<tr><td>8</td><td>GPT-6</td><td><b>0.848</b></td><td>0.842</td><td>29/30</td><td>0.802</td><td>0.897</td><td>0.897</td></tr>
|
| 32 |
+
<tr><td>9</td><td>Gemini-4-Argon</td><td><b>0.838</b></td><td>0.830</td><td>30/30</td><td>0.776</td><td>0.894</td><td>0.913</td></tr>
|
| 33 |
+
<tr><td>10</td><td>MiMo-V2.6-Pro</td><td><b>0.837</b></td><td>0.830</td><td>30/30</td><td>0.778</td><td>0.878</td><td>0.924</td></tr>
|
| 34 |
+
</tbody></table></div>
|
| 35 |
+
<h2>Key findings</h2>
|
| 36 |
+
<ul>
|
| 37 |
+
<li><b>Plan generation is the hardest domain for every model.</b> PG scores range from 0.776 to 0.860, compared with 0.878–0.932 on DA and 0.897–0.949 on QA.</li>
|
| 38 |
+
<li><b>The top 10 models are within 6 points.</b> In a bootstrap over the 50 open-ended questions, Claude Opus 5.5 stays in 1st–2nd place (90% interval), but the order from 4th place down is not stable.</li>
|
| 39 |
+
<li><b>Multiple choice is nearly saturated.</b> 8 of 10 models answer all 30 correctly.</li>
|
| 40 |
+
</ul>
|
| 41 |
+
<img src="domain_scores.png" alt="Domain scores for the 10 leaderboard models; every model scores lowest on plan generation">
|
| 42 |
+
<h2>How scores are computed</h2>
|
| 43 |
+
<ul class="note">
|
| 44 |
+
<li>Scores range from 0 to 1: points earned divided by points possible.</li>
|
| 45 |
+
<li>Open-ended questions are scored against expert rubrics by two LLM judges, and the two scores are averaged. Multiple-choice questions are scored by exact match.</li>
|
| 46 |
+
<li>Scores come from each model's full 809-question run, keeping only the 80 public questions. They are not the paper's full-benchmark scores.</li>
|
| 47 |
+
<li>Rubrics and reference answers have been public on GitHub, so results may be affected by data contamination. Treat them as indicative.</li>
|
| 48 |
+
<li>To be listed, submit your model's answers following the submission guide. Maintainers score and review submissions before publishing.</li>
|
| 49 |
+
</ul>
|
| 50 |
+
</main></body></html>
|