Update README.md
Browse files
README.md
CHANGED
|
@@ -116,7 +116,7 @@ Therefore, our results represent a best-effort attempt at a fair comparison.
|
|
| 116 |
| SWE-bench Verified | 76.5 | 71.9 | 77.6 | *78.7* | **81.6** |
|
| 117 |
| SWE-bench Pro v1.0 | 61.42 | *46.9* | 54.3 | *58.2* | **66.1** |
|
| 118 |
| SWE-bench Pro v2.0 Hard | **79.1** | *30.7* | *2.0* | *52.3* | 76.5 |
|
| 119 |
-
| DeepSWE 1.1 | 44.
|
| 120 |
| SciCode (Inspect AI) | 39.4 | 44.6 | 46.1 | **58.5** | 49.2 |
|
| 121 |
| τ³-bench banking | 31.27 | 22.6 | 23.7 | *14.4* | **36.1** |
|
| 122 |
| AutomationBench (Public) | 36.4 | *8.4* | *14.6* | *42.4* | 39.3 |
|
|
|
|
| 116 |
| SWE-bench Verified | 76.5 | 71.9 | 77.6 | *78.7* | **81.6** |
|
| 117 |
| SWE-bench Pro v1.0 | 61.42 | *46.9* | 54.3 | *58.2* | **66.1** |
|
| 118 |
| SWE-bench Pro v2.0 Hard | **79.1** | *30.7* | *2.0* | *52.3* | 76.5 |
|
| 119 |
+
| DeepSWE 1.1 | 44.3 | *0.2* | *1.8* | **60.0** | 43.3 |
|
| 120 |
| SciCode (Inspect AI) | 39.4 | 44.6 | 46.1 | **58.5** | 49.2 |
|
| 121 |
| τ³-bench banking | 31.27 | 22.6 | 23.7 | *14.4* | **36.1** |
|
| 122 |
| AutomationBench (Public) | 36.4 | *8.4* | *14.6* | *42.4* | 39.3 |
|