Update README.md
Browse filesFixed SWEBench v2 Hard row
README.md
CHANGED
|
@@ -111,7 +111,7 @@ Therefore, our results represent a best-effort attempt at a fair comparison.
|
|
| 111 |
| Terminal-Bench 2.1 (Terminus 2) | **80.5** | *55.1* | *56.2* | *78.7* | *70.8* |
|
| 112 |
| SWE-bench Verified | 76.5 | 71.9 | 77.6 | *78.7* | **81.6** |
|
| 113 |
| SWE-bench Pro v1.0 | 61.42 | *46.9* | 54.3 | *58.2* | **66.1** |
|
| 114 |
-
| SWE-bench Pro v2.0 Hard | **79.1** | *30.7* | *
|
| 115 |
| DeepSWE 1.1 | 44.3 | *0.2* | *1.8* | **60.0** | 43.3 |
|
| 116 |
| SciCode (Inspect AI) | 39.4 | 44.6 | 46.1 | **58.5** | 49.2 |
|
| 117 |
| τ³-bench banking | 31.27 | 22.6 | 23.7 | *14.4* | **36.1** |
|
|
|
|
| 111 |
| Terminal-Bench 2.1 (Terminus 2) | **80.5** | *55.1* | *56.2* | *78.7* | *70.8* |
|
| 112 |
| SWE-bench Verified | 76.5 | 71.9 | 77.6 | *78.7* | **81.6** |
|
| 113 |
| SWE-bench Pro v1.0 | 61.42 | *46.9* | 54.3 | *58.2* | **66.1** |
|
| 114 |
+
| SWE-bench Pro v2.0 Hard | **79.1** | *30.7* | *39.6* | *72.4* | 76.5 |
|
| 115 |
| DeepSWE 1.1 | 44.3 | *0.2* | *1.8* | **60.0** | 43.3 |
|
| 116 |
| SciCode (Inspect AI) | 39.4 | 44.6 | 46.1 | **58.5** | 49.2 |
|
| 117 |
| τ³-bench banking | 31.27 | 22.6 | 23.7 | *14.4* | **36.1** |
|