Update README.md
Browse files
README.md
CHANGED
|
@@ -108,7 +108,7 @@ Therefore, our results represent a best-effort attempt at a fair comparison.
|
|
| 108 |
| Terminal-Bench 2.1 (self-reported) | **80.5** | 56.4 | 63.8 | 76.4 | 80.1 |
|
| 109 |
| Terminal-Bench 2.1 (Terminus 2) | **80.5** | *55.1* | *56.2* | *78.7* | *70.8* |
|
| 110 |
| SWE-bench Verified | 76.5 | 71.9 | 77.6 | *78.7* | **81.6** |
|
| 111 |
-
| SWE-bench Pro v1.0 | 61.42 | *46.9* | 54.3 |
|
| 112 |
| SWE-bench Pro v2.0 Hard | **79.1** | *30.7* | *2.0* | *52.3* | 76.5 |
|
| 113 |
| DeepSWE 1.1 | 44.2 | *0.2* | *1.8* | **60.0** | 43.3 |
|
| 114 |
| SciCode | 39.4 | 44.6 | *47.0* | **58.5** | 49.2 |
|
|
|
|
| 108 |
| Terminal-Bench 2.1 (self-reported) | **80.5** | 56.4 | 63.8 | 76.4 | 80.1 |
|
| 109 |
| Terminal-Bench 2.1 (Terminus 2) | **80.5** | *55.1* | *56.2* | *78.7* | *70.8* |
|
| 110 |
| SWE-bench Verified | 76.5 | 71.9 | 77.6 | *78.7* | **81.6** |
|
| 111 |
+
| SWE-bench Pro v1.0 | 61.42 | *46.9* | 54.3 | *58.2* | **66.1** |
|
| 112 |
| SWE-bench Pro v2.0 Hard | **79.1** | *30.7* | *2.0* | *52.3* | 76.5 |
|
| 113 |
| DeepSWE 1.1 | 44.2 | *0.2* | *1.8* | **60.0** | 43.3 |
|
| 114 |
| SciCode | 39.4 | 44.6 | *47.0* | **58.5** | 49.2 |
|