decider-31b / decider_config.json
Mapika's picture
decider-31b v2: text and image decisions, ECE_bw 0.018; v1 under tag v1
53e0a1b verified
Raw History Blame Contribute Delete
568 Bytes
{
"version": "31b-v2",
"layout": "chat",
"temperature_by_options": {"a": 2.064, "b": -0.053, "min": 0.05},
"second_reading": {"below": 0.7, "temperature_by_options": {"a": 1.904, "b": -0.022, "min": 0.05}},
"vllm_attention": "TRITON_ATTN",
"images": true,
"neutralize_none": false,
"isolated_levels": false,
"base": "google/gemma-4-31B-it, fine-tuned (text + image decisions) and merged, NVFP4 (MLP) / bf16 (attention, vision tower) / FP8 KV cache",
"requires": "decider-ai>=1.10.0 with vLLM 0.29.0 (decider.serve_vllm; DECIDER_IMAGES=1 for image assets)"
}