The benchmarks evaluate LM agent on SWE/Computer-use tasks across different operating systems.
SWE-bench-Live
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
Organization Card
SWE-bench-Live
Here we host SWE-bench-Live dataset, with continuous monthly updates!
models 0
None public yet
datasets 6
SWE-bench-Live/SWE-bench-Live
Viewer • Updated • 3.69k • 37.9k • 10
SWE-bench-Live/MultiLang
Viewer • Updated • 1.08k • 17.4k • 3
SWE-bench-Live/Windows
Viewer • Updated • 66 • 1.21k • 1
SWE-bench-Live/OS-bench
Viewer • Updated • 140 • 1.25k • 1
SWE-bench-Live/ORACLE-SWE
Viewer • Updated • 8 • 1.24k • 2
SWE-bench-Live/repo-build-test-benchmark
Viewer • Updated • 152 • 770