Add community evaluation results for DeepSWE

#18
by nielsr HF Staff - opened
Files changed (1) hide show
  1. .eval_results/deep-swe.yaml +8 -0
.eval_results/deep-swe.yaml ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: datacurve/deep-swe
3
+ task_id: deep_swe
4
+ value: 30.53
5
+ notes: "Pass@1 over 452 attempts on 113 tasks, mini-swe-agent harness."
6
+ source:
7
+ url: https://deepswe.datacurve.ai/
8
+ name: DeepSWE Leaderboard