AgentDecision-0.8B / thresholds.json
Leozkl's picture
AgentDecision-0.8B: adapter, tokenizer, calibration, thresholds and model card
2cae2d0 verified
Raw History Blame Contribute Delete
722 Bytes
{
"description": "Confidence thresholds of the cascade: the harness uses the model's answer when its calibrated confidence (calibration.json applied) is >= tau, and lets the agent LLM decide otherwise. Refit them for another agent LLM, other tools or another task family.",
"rule": ">=",
"agent_llm": "gemini-3.5-flash",
"tool_select": 0.9516002311101601,
"tool_params": 0.9989569187164307,
"fitted_on": "the agent states of a shadow-mode calibration run (150 DecisionGym tasks, seeds 5000-5149, Gemini 3.5 Flash as the agent LLM), answered by this model with calibration.json applied",
"source": "research/results/explore/e28_sl08b/cal/fits.json; harness profile research/configs/harness/explore_e28_final.yaml"
}