Leon02 commited on
Commit
8604635
·
verified ·
1 Parent(s): f51ec79

Add ExoMind model card

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -74,7 +74,7 @@ This repository hosts the main checkpoint, fine-tuned from
74
  [Qwen3.5-35B-A3B](https://huggingface.co/Qwen/Qwen3.5-35B-A3B). With
75
  training-value-aware data engineering, a scientific interaction framework, and
76
  two-stage progressive Chain-of-Interaction training, ExoMind raises the average
77
- score across eight scientific benchmarks from **36.2 to 67.5**, achieves the
78
  highest average among all evaluated models, and ranks first on six benchmarks.
79
 
80
  ## Highlights
@@ -154,7 +154,7 @@ in the [ExoMind GitHub repository](https://github.com/AI4SGI/ExoMind).
154
  ## Evaluation
155
 
156
  Under the technical report's evaluation setup, ExoMind reaches an
157
- eight-benchmark average of **67.5**, compared with **54.2** for the next-best
158
  representative model shown below.
159
 
160
  <p>
@@ -181,7 +181,7 @@ representative model shown below.
181
  </thead>
182
  <tbody>
183
  <tr><td colspan="9" align="left"><b>🧪 Scientific Research</b></td></tr>
184
- <tr><td align="left">HLE w/ tools</td><td align="center">50.9</td><td align="center">🥇 57.9</td><td align="center">52.2</td><td align="center">51.4</td><td align="center">56.0</td><td align="center">53.5</td><td align="center">54.7</td><td align="center">48.2</td></tr>
185
  <tr><td align="left">FrontierScience-Research</td><td align="center">🥇 70.0</td><td align="center">26.7</td><td align="center">26.7</td><td align="center">11.7</td><td align="center">21.7</td><td align="center">10.0</td><td align="center">15.0</td><td align="center">13.3</td></tr>
186
  <tr><td align="left">CMT-Benchmark</td><td align="center">🥇 84.0</td><td align="center">46.0</td><td align="center">43.0</td><td align="center">43.0</td><td align="center">34.0</td><td align="center">34.0</td><td align="center">20.0</td><td align="center">28.0</td></tr>
187
  <tr><td align="left">CritPt</td><td align="center">25.7</td><td align="center">20.9</td><td align="center">🥇 27.1</td><td align="center">17.7</td><td align="center">23.4</td><td align="center">13.4</td><td align="center">20.9</td><td align="center">7.1</td></tr>
@@ -190,7 +190,7 @@ representative model shown below.
190
  <tr><td align="left">IMO-AnswerBench</td><td align="center">🥇 92.8</td><td align="center">86.8</td><td align="center">83.8</td><td align="center">90.0</td><td align="center">82.8</td><td align="center">90.0</td><td align="center">91.0</td><td align="center">89.8</td></tr>
191
  <tr><td align="left">HiPhO</td><td align="center">🥇 49.7</td><td align="center">46.4</td><td align="center">43.3</td><td align="center">43.4</td><td align="center">42.4</td><td align="center">38.8</td><td align="center">37.4</td><td align="center">38.7</td></tr>
192
  <tr><td align="left">FrontierScience-Olympiad</td><td align="center">🥇 89.0</td><td align="center">75.0</td><td align="center">78.0</td><td align="center">77.0</td><td align="center">69.0</td><td align="center">80.0</td><td align="center">76.5</td><td align="center">76.0</td></tr>
193
- <tr><td align="left"><b>Eight-benchmark average</b></td><td align="center">🥇 67.5</td><td align="center">54.2</td><td align="center">53.0</td><td align="center">49.7</td><td align="center">49.2</td><td align="center">47.1</td><td align="center">46.2</td><td align="center">46.1</td></tr>
194
  </tbody>
195
  </table>
196
 
 
74
  [Qwen3.5-35B-A3B](https://huggingface.co/Qwen/Qwen3.5-35B-A3B). With
75
  training-value-aware data engineering, a scientific interaction framework, and
76
  two-stage progressive Chain-of-Interaction training, ExoMind raises the average
77
+ score across eight scientific benchmarks from **36.2 to 68.3**, achieves the
78
  highest average among all evaluated models, and ranks first on six benchmarks.
79
 
80
  ## Highlights
 
154
  ## Evaluation
155
 
156
  Under the technical report's evaluation setup, ExoMind reaches an
157
+ eight-benchmark average of **68.3**, compared with **54.2** for the next-best
158
  representative model shown below.
159
 
160
  <p>
 
181
  </thead>
182
  <tbody>
183
  <tr><td colspan="9" align="left"><b>🧪 Scientific Research</b></td></tr>
184
+ <tr><td align="left">HLE w/ tools</td><td align="center">56.8</td><td align="center">🥇 57.9</td><td align="center">52.2</td><td align="center">51.4</td><td align="center">56.0</td><td align="center">53.5</td><td align="center">54.7</td><td align="center">48.2</td></tr>
185
  <tr><td align="left">FrontierScience-Research</td><td align="center">🥇 70.0</td><td align="center">26.7</td><td align="center">26.7</td><td align="center">11.7</td><td align="center">21.7</td><td align="center">10.0</td><td align="center">15.0</td><td align="center">13.3</td></tr>
186
  <tr><td align="left">CMT-Benchmark</td><td align="center">🥇 84.0</td><td align="center">46.0</td><td align="center">43.0</td><td align="center">43.0</td><td align="center">34.0</td><td align="center">34.0</td><td align="center">20.0</td><td align="center">28.0</td></tr>
187
  <tr><td align="left">CritPt</td><td align="center">25.7</td><td align="center">20.9</td><td align="center">🥇 27.1</td><td align="center">17.7</td><td align="center">23.4</td><td align="center">13.4</td><td align="center">20.9</td><td align="center">7.1</td></tr>
 
190
  <tr><td align="left">IMO-AnswerBench</td><td align="center">🥇 92.8</td><td align="center">86.8</td><td align="center">83.8</td><td align="center">90.0</td><td align="center">82.8</td><td align="center">90.0</td><td align="center">91.0</td><td align="center">89.8</td></tr>
191
  <tr><td align="left">HiPhO</td><td align="center">🥇 49.7</td><td align="center">46.4</td><td align="center">43.3</td><td align="center">43.4</td><td align="center">42.4</td><td align="center">38.8</td><td align="center">37.4</td><td align="center">38.7</td></tr>
192
  <tr><td align="left">FrontierScience-Olympiad</td><td align="center">🥇 89.0</td><td align="center">75.0</td><td align="center">78.0</td><td align="center">77.0</td><td align="center">69.0</td><td align="center">80.0</td><td align="center">76.5</td><td align="center">76.0</td></tr>
193
+ <tr><td align="left"><b>Eight-benchmark average</b></td><td align="center">🥇 68.3</td><td align="center">54.2</td><td align="center">53.0</td><td align="center">49.7</td><td align="center">49.2</td><td align="center">47.1</td><td align="center">46.2</td><td align="center">46.1</td></tr>
194
  </tbody>
195
  </table>
196