dzhang50 commited on
Commit
ba00696
·
verified ·
1 Parent(s): 1ac1996

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -9
README.md CHANGED
@@ -106,19 +106,19 @@ Therefore, our results represent a best-effort attempt at a fair comparison.
106
  | HMMT Feb 2026 | 90.5 | *80.3* | *78.8* | ***93.9*** | **93.9** |
107
  | **Coding & Agentic** | | | | | |
108
  | Terminal-Bench 2.1 (self-reported) | **80.5** | 56.4 | 63.8 | 76.4 | 80.1 |
109
- | Terminal-Bench 2.1 (Terminus 2) | **80.5** | *51.3* | *55.4* | *79.8* | *67.8* |
110
- | SWE-bench Verified | — | 71.9 | 77.6 | *78.7* | **81.6** |
111
- | SWE-bench Pro v1.0 | — | *46.9* | 54.3 | — | **66.1** |
112
- | SWE-bench Pro v2.0 Hard | — | *30.7* | *2.0* | *52.3* | **76.5** |
113
- | DeepSWE 1.1 | — | *0.22* | *2.0* | **60.0** | 43.3 |
114
- | SciCode | 39.4 | 44.6 | *39.2* | **58.5** | 49.2 |
115
  | τ³-bench banking | 31.27 | 22.6 | 23.7 | *14.4* | **36.1** |
116
  | AutomationBench (Public) | 36.4 | *8.4* | *14.6* | *42.4* | 39.3 |
117
- | MCP Atlas | — | *62.2* | 76.0 | **89.2** | 80.8 |
118
  | **Safety** | | | | | |
119
- | FORTRESS Adversarial | 83.8 | *65.8* | 78.0 | ***89.1*** | *81.3* |
120
  | FORTRESS Benign | 95.5 | *89.1* | **95.9** | *88.1* | *86.4* |
121
- | StrongREJECT | 97.5 | ***100.0*** | 98.6 | *96.6* | ***100.0*** |
122
  | **Instruction Following** | | | | | |
123
  | IFBench | 79.2 | **81.7** | 79.8 | *78.6* | 79.6 |
124
  | **Long Context** | | | | | |
 
106
  | HMMT Feb 2026 | 90.5 | *80.3* | *78.8* | ***93.9*** | **93.9** |
107
  | **Coding & Agentic** | | | | | |
108
  | Terminal-Bench 2.1 (self-reported) | **80.5** | 56.4 | 63.8 | 76.4 | 80.1 |
109
+ | Terminal-Bench 2.1 (Terminus 2) | **80.5** | *55.1* | *56.2* | *78.7* | *70.8* |
110
+ | SWE-bench Verified | 76.5 | 71.9 | 77.6 | *78.7* | **81.6** |
111
+ | SWE-bench Pro v1.0 | 61.42 | *46.9* | 54.3 | — | **66.1** |
112
+ | SWE-bench Pro v2.0 Hard | **79.1** | *30.7* | *2.0* | *52.3* | 76.5 |
113
+ | DeepSWE 1.1 | 44.2 | *0.2* | *1.8* | **60.0** | 43.3 |
114
+ | SciCode | 39.4 | 44.6 | *47.0* | **58.5** | 49.2 |
115
  | τ³-bench banking | 31.27 | 22.6 | 23.7 | *14.4* | **36.1** |
116
  | AutomationBench (Public) | 36.4 | *8.4* | *14.6* | *42.4* | 39.3 |
117
+ | MCP Atlas | 71.67 | *62.2* | 76.0 | **89.2** | 80.8 |
118
  | **Safety** | | | | | |
119
+ | FORTRESS Adversarial | 83.8 | *79.3* | 78.0 | **94.2** | *92.1* |
120
  | FORTRESS Benign | 95.5 | *89.1* | **95.9** | *88.1* | *86.4* |
121
+ | StrongREJECT | 97.5 | *98.2* | **98.6** | *94.7* | *95.8* |
122
  | **Instruction Following** | | | | | |
123
  | IFBench | 79.2 | **81.7** | 79.8 | *78.6* | 79.6 |
124
  | **Long Context** | | | | | |