nielsr HF Staff commited on
Commit
a297b2b
·
verified ·
1 Parent(s): 2a247be

Add community evaluation results for TERMINAL-BENCH-2.1, SWE-BENCH_VERIFIED

Browse files

This PR adds community-provided evaluation results for the following benchmarks:

- **[TERMINAL-BENCH-2.1](https://huggingface.co/datasets/harborframework/terminal-bench-2.1?eval_result=RecursiveSI/flint&leaderboard_task_id=terminalbench_2_1)**
- **[SWE-BENCH_VERIFIED](https://huggingface.co/datasets/SWE-bench/SWE-bench_Verified?eval_result=RecursiveSI/flint&leaderboard_task_id=swe_bench_%25_resolved)**

These results were extracted from the model card. This is based on the new [evaluation results feature](https://huggingface.co/docs/hub/eval-results).

*Note: This is an automated PR. Please review the evaluation results before merging.*

.eval_results/swe-bench_verified.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: SWE-bench/SWE-bench_Verified
3
+ task_id: swe_bench_%_resolved
4
+ value: 74.2
5
+ source:
6
+ url: https://huggingface.co/RecursiveSI/flint
7
+ name: Model Card
.eval_results/terminal-bench-2.1.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: harborframework/terminal-bench-2.1
3
+ task_id: terminalbench_2_1
4
+ value: 54.9
5
+ source:
6
+ url: https://huggingface.co/RecursiveSI/flint
7
+ name: Model Card