verdict-typed-small

intfloat/multilingual-e5-small (118M) fine-tuned for 3 epochs on the train split of LocalLLaMA/typed-decisions with the teacher's soft probabilities as targets, the same protocol Laya used for its 0.766. Scores 0.689 on the 2,000 test decisions (Jev 0.727 zero-shot, Laya typed-decisions 0.766). Published as a reproducible comparison point, not as the default model.

from verdict import Verdict
v = Verdict(model="Manav2op/verdict-typed-small")

Part of Verdict. Training script: train/finetune_typed.py. Full benchmark table: docs/BENCHMARKS.md.

Downloads last month: 26

Safetensors

Model size

0.1B params

Tensor type

F32

Model tree for Manav2op/verdict-typed-small

Base model

intfloat/multilingual-e5-small

Finetuned

(202)

this model

Collection including Manav2op/verdict-typed-small

Verdict: small, fast, honest decision models

Collection

Open Jev/Laya-style decision models with calibrated probabilities and a conformal abstain set. Weights, browser playground, checkpoints. • 4 items • Updated 13 days ago

Evaluation results

accuracy (all) on typed-decisions
test set self-reported

0.689
accuracy (choice) on typed-decisions
test set self-reported

0.702
accuracy (noul) on typed-decisions
test set self-reported

0.767
accuracy (score) on typed-decisions
test set self-reported

0.621