Add safeagents judge bench results

#12
by ybelkada HF Staff - opened

YAML Metadata Error:Invalid content in Eval Result file .eval_results/safeagents-judge-bench.yaml

Check out the documentation for more information.

Show details
Task ID "balanced_accuracy" does not match any task in dataset "harness-hub/safeagents-judge-bench". Available: none

YAML Metadata Error:Invalid content in Eval Result file .eval_results/safeagents-judge-bench.yaml

Check out the documentation for more information.

Show details
Task ID "auroc" does not match any task in dataset "harness-hub/safeagents-judge-bench". Available: none

YAML Metadata Error:Invalid content in Eval Result file .eval_results/safeagents-judge-bench.yaml

Check out the documentation for more information.

Show details
Task ID "false_block_rate" does not match any task in dataset "harness-hub/safeagents-judge-bench". Available: none

YAML Metadata Error:Invalid content in Eval Result file .eval_results/safeagents-judge-bench.yaml

Check out the documentation for more information.

Show details
Task ID "category_macro_f1" does not match any task in dataset "harness-hub/safeagents-judge-bench". Available: none
.eval_results/safeagents-judge-bench.yaml ADDED
@@ -0,0 +1,32 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: harness-hub/safeagents-judge-bench
3
+ task_id: balanced_accuracy
4
+ value: 0.823
5
+ date: "2026-10-30"
6
+ source:
7
+ url: https://huggingface.co/datasets/harness-hub/safeagents-judge-bench
8
+ name: "safeagents judge bench v0, test split, run on Apple M5 Pro (MPS)"
9
+ - dataset:
10
+ id: harness-hub/safeagents-judge-bench
11
+ task_id: auroc
12
+ value: 0.919
13
+ date: "2026-10-30"
14
+ source:
15
+ url: https://huggingface.co/datasets/harness-hub/safeagents-judge-bench
16
+ name: "safeagents judge bench v0, test split, run on Apple M5 Pro (MPS)"
17
+ - dataset:
18
+ id: harness-hub/safeagents-judge-bench
19
+ task_id: false_block_rate
20
+ value: 0.026
21
+ date: "2026-10-30"
22
+ source:
23
+ url: https://huggingface.co/datasets/harness-hub/safeagents-judge-bench
24
+ name: "safeagents judge bench v0, test split, run on Apple M5 Pro (MPS)"
25
+ - dataset:
26
+ id: harness-hub/safeagents-judge-bench
27
+ task_id: category_macro_f1
28
+ value: 0.238
29
+ date: "2026-10-30"
30
+ source:
31
+ url: https://huggingface.co/datasets/harness-hub/safeagents-judge-bench
32
+ name: "safeagents judge bench v0, test split, run on Apple M5 Pro (MPS)"