Text Classification
Transformers
Safetensors
English
gemma4
image-text-to-text
decision-model
classification
calibration
routing
guardrails
vision
multimodal
baseten
Instructions to use baselabs/bison-1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use baselabs/bison-1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="baselabs/bison-1")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("baselabs/bison-1") model = AutoModelForMultimodalLM.from_pretrained("baselabs/bison-1", device_map="auto") - Notebooks
- Google Colab
- Kaggle
File size: 5,597 Bytes
60988ce bf8350b 06f37ef bf8350b 06f37ef d304174 063726c d304174 06f37ef d304174 06f37ef d304174 06f37ef d304174 06f37ef d304174 06f37ef bf8350b | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 | ---
license: other
license_name: mit-and-apache-2.0
license_link: LICENSE
library_name: transformers
base_model: google/gemma-4-31B-it
base_model_relation: finetune
pipeline_tag: text-classification
language:
- en
tags:
- decision-model
- classification
- calibration
- routing
- guardrails
- vision
- multimodal
- baseten
---
<div align="center">
<img
src="https://huggingface.co/baselabs/bison-1/resolve/main/assets/banner.png"
alt="Baseten bison-1 decision model"
style="width: 100%; max-width: 100%; height: auto; display: inline-block; margin-bottom: 0.5em; margin-top: 0.5em;"
/>
<div style="display: flex; justify-content: center; gap: 0.5em; margin-bottom: 1em;">
<a href="https://www.baseten.co/library/bison-1/"><strong>Try on Baseten</strong></a>
</div>
</div>
# bison-1
bison-1 is a 31B parameter **decision model** post-trained from [Gemma-4-31B](https://huggingface.co/google/gemma-4-31B-it) by Base Labs at Baseten.
Provide the model a state (text, optionally with images) and a set of questions and it will return a calibrated probability for every option,
answering all questions from **one shared-prefix prefill**, without generating text. On tested benchmarks:
- **#1 of 19 decision models on the Artificial Analysis Decision Index v2.1**: 76, ahead of d1.2-ultra (75) and mammoth-1 (71).
- **Best-calibrated model on that index**: Brier score 0.14.
For faster, cheaper decisions, see the mixture-of-experts sibling [groundhog-1](https://huggingface.co/baselabs/groundhog-1).
## 🗒️ Model Details
| Model | Parameters | Description |
|---|---|---|
| [Gemma-4-31B](https://huggingface.co/google/gemma-4-31B-it) | 31B | General-purpose base model |
| **[bison-1](https://huggingface.co/baselabs/bison-1)** | 31B | Post-trained for single-pass, calibrated decisions |
| [groundhog-1](https://huggingface.co/baselabs/groundhog-1) | 26B (about 4B active) | Mixture-of-experts sibling, fastest decisions |
- **Inputs**: text and images
- **Training**: full fine-tune of the language model on text and image decisions; the vision encoder, norms and embeddings are frozen
- **Attention**: block-bidirectional mask on full-attention layers; sliding-window layers stay causal.
- **Max sequence length**: 131,072 tokens
## 🏃 How to use
### Baseten Model APIs
bison-1 is available on [Baseten Model APIs](https://www.baseten.co/library/bison-1/) as `decision-models/baseten-bison-latest`, at $0.10 per 1M tokens. It uses the same API as mammoth-1 and elephant-1, and the endpoint accepts text and image inputs.
### Request format
A request carries one `state` and any number of `questions`. Every question is answered in the same call.
```python
questions = {
"refund": {"type": "noul", "instructions": "Is the customer asking for a refund?"},
"team": {
"type": "choice",
"instructions": "Which team should handle this?",
"criteria": {"billing": "Charges, refunds, invoices",
"technical": "App or site faults",
"fraud": "Suspected unauthorised use"},
},
"urgency": {
"type": "score",
"instructions": "How urgent is this?",
"criteria": ["Can wait", "Today", "Blocking the customer now"],
},
}
request = {"state": "I was charged twice this month, please refund one of them.", "questions": questions}
```
| `type` | `criteria` | answer fields |
|---|---|---|
| `noul`: yes or no | optional | `noul`: P(yes) |
| `choice`: one of named options | `{name: description}` | `choice`, `probabilities` |
| `score`: ordered levels | list of levels, lowest first | `score`, `probabilities` |
Requests longer than the trained length limits are refused, not truncated.
## 📊 Performance
### Artificial Analysis Decision Index v2.1
Scored by Artificial Analysis, November 19, 2026.
| Model | Decision Index |
|---|---:|
| **bison-1** | **76** |
| d1.2-ultra | 75 |
| Drex Max v1.1 | 73 |
| SubQ Snap 1.2 | 73 |
| GLiDE v1.2 | 73 |
| mammoth-1 | 71 |
| Benchmark | bison-1 | Rank of 19 |
|---|---:|---:|
| AA-Paperclip | 73 | 2 |
| EvalSafe-O*NET-AA | 93 | 1 |
| When2Call | 98 | 1 |
| AA-Omniscience-Decision v1.1 | 60 | 11 |
| HLE-MultiChoice v1.1 | 51 | 1 |
| AA-Symmetry v1.1 | 89 | 1 |
### Long context (our run)
| Benchmark | bison-1 |
|---|---:|
| LongMemEval M, 128k tokens | 84.8 |
| LongMemEval S, 128k tokens | 87.1 |
## 🔧 Training
- **Data**: 6.71M decision examples (Mix 12): core decision skills, safety and abstention, judging and expert domains, document and long-context tasks, and public decision data, including public benchmark sets.
- **Objective**: cross-entropy plus a Brier calibration term (λ = 1), with a trained "I don't know" option. About one example in seven carries a probability target instead of a single right answer.
- **Recipe**: 1 epoch (3,747 steps), peak LR 5e-6, no weight decay, 3% warm-up, bf16, sequences up to 131,072 tokens.
- **Hardware**: 24 nodes × 8 B200 (192 GPUs).
## License
bison-1 is fine-tuned by Baseten from [Gemma 4 31B IT](https://huggingface.co/google/gemma-4-31B-it), which is licensed under the [Apache License 2.0](https://www.apache.org/licenses/LICENSE-2.0). Baseten's modifications are released under the MIT License. Use of the model is subject to both licenses; see [LICENSE](LICENSE) and [NOTICE](NOTICE).
## Attribution
Base model: Gemma 4 31B IT, made available by Google LLC, licensed under the Apache License 2.0. Baseten modified the weights by further training. Gemma is a trademark of Google LLC. This model is not affiliated with or endorsed by Google.
|