yannelli
/

d1-3b-cli-command-risk

Text Classification

feature-extraction

typed-decisions

Eval Results (legacy)

Model card Files Files and versions

yannelli commited on 11 days ago

Commit

f4c2d90

·

verified ·

1 Parent(s): 0afa83e

Model card: drop a repeated sentence

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -161,7 +161,7 @@ The model accepts other questions in the same schema, but it was trained and eva
 ## Results
-Results cover all 12,689 rows of the `test` split: 97 template families and 2,551 distinct commands, each in up to five shells. No test family appears in training. Each command was one request with all 17 questions, scored with `training/score_cli_decisions.py`, which computes the same columns as the scorer of [JS/TS Code Review Decisions](https://huggingface.co/datasets/yannelli/js-ts-code-review-decisions).
 | Model | Macro F1 @ 0.5 | Level macro F1 | Accuracy | Log loss | Brier | ECE | Safe judged safe |
 |---|---:|---:|---:|---:|---:|---:|---:|

 ## Results
+Results cover all 12,689 rows of the `test` split: 97 template families and 2,551 distinct commands, each in up to five shells. Each command was one request with all 17 questions, scored with `training/score_cli_decisions.py`, which computes the same columns as the scorer of [JS/TS Code Review Decisions](https://huggingface.co/datasets/yannelli/js-ts-code-review-decisions).
 | Model | Macro F1 @ 0.5 | Level macro F1 | Accuracy | Log loss | Brier | ECE | Safe judged safe |
 |---|---:|---:|---:|---:|---:|---:|---:|