dzhang50 commited on
Commit
30cb3b0
·
verified ·
1 Parent(s): e27e171

Update README.md

Browse files

Fixed SWEBench v2 Hard row

Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -111,7 +111,7 @@ Therefore, our results represent a best-effort attempt at a fair comparison.
111
  | Terminal-Bench 2.1 (Terminus 2) | **80.5** | *55.1* | *56.2* | *78.7* | *70.8* |
112
  | SWE-bench Verified | 76.5 | 71.9 | 77.6 | *78.7* | **81.6** |
113
  | SWE-bench Pro v1.0 | 61.42 | *46.9* | 54.3 | *58.2* | **66.1** |
114
- | SWE-bench Pro v2.0 Hard | **79.1** | *30.7* | *2.0* | *52.3* | 76.5 |
115
  | DeepSWE 1.1 | 44.3 | *0.2* | *1.8* | **60.0** | 43.3 |
116
  | SciCode (Inspect AI) | 39.4 | 44.6 | 46.1 | **58.5** | 49.2 |
117
  | τ³-bench banking | 31.27 | 22.6 | 23.7 | *14.4* | **36.1** |
 
111
  | Terminal-Bench 2.1 (Terminus 2) | **80.5** | *55.1* | *56.2* | *78.7* | *70.8* |
112
  | SWE-bench Verified | 76.5 | 71.9 | 77.6 | *78.7* | **81.6** |
113
  | SWE-bench Pro v1.0 | 61.42 | *46.9* | 54.3 | *58.2* | **66.1** |
114
+ | SWE-bench Pro v2.0 Hard | **79.1** | *30.7* | *39.6* | *72.4* | 76.5 |
115
  | DeepSWE 1.1 | 44.3 | *0.2* | *1.8* | **60.0** | 43.3 |
116
  | SciCode (Inspect AI) | 39.4 | 44.6 | 46.1 | **58.5** | 49.2 |
117
  | τ³-bench banking | 31.27 | 22.6 | 23.7 | *14.4* | **36.1** |