Add files using upload-large-folder tool

be49542 verified 15 days ago

5.93 kB

---
pipeline_tag: zero-shot-classification
license: apache-2.0
base_model: Qwen/Qwen3.8-27B
library_name: transformers
tags:
- decision-model
- classification
- system-one
- multimodal
- vision
- maincode
- matilda
---
# Matilda Decision v1

**Matilda Decision** is a 27B multimodal decision model from Maincode. You give it an input (text or JSON,
optionally with images) and the questions you need answered: pick one of several options, say yes or no, or rate
on a scale. It answers them all in one call and returns a probability for every answer, without generating text.

| | |
| --- | --- |
| **Parameters** | 26.1B, including the vision encoder |
| **Inputs** | Text or JSON, plus images (several per request, up to 1.6 MP each) |
| **Decision types** | Choice (up to 255 options) · Yes / No · Score |
| **License** | Apache-2.0 |

## Evaluation

These are results on the **public sets only, for now**.

### Text: Jev Decision Index 0.3, public suite

All 140,178 public requests answered, none unsupported.

| Model | Public index ↑ | Knowledge & Reasoning | Language | Retrieval & Classification | Tools & Automation | Arts & Taste |
| --- | ---: | ---: | ---: | ---: | ---: | ---: |
| **Matilda Decision v1 (27B)** | **65.38** | 51.1 | 71.3 | 67.6 | 84.6 | 47.4 |
| Torchcast Decision 27B | 65.10 | 46.7 | 72.0 | 67.5 | 84.6 | 54.4 |
| Perplexity Decider v1.1 (27B) | 62.25 | 52.0 | 67.5 | 61.3 | 78.9 | 47.0 |
| Jev | 57.96 | 53.9 | 59.2 | 55.4 | 75.1 | 39.1 |

<sub>Matilda Decision: our run with the official 0.3 kit. Others: Decision Index 0.3 board, public results
(area scores computed from the board's per-benchmark results with the kit's own scoring).</sub>

## Quickstart

```bash
pip install "transformers==5.17.0" torch torchvision pillow safetensors
pip install flash-linear-attention  # optional: fast GPU kernels for the linear-attention layers
```

```python
import json
from transformers import AutoModel
model = AutoModel.from_pretrained("Maincode/matilda-decision-v1", trust_remote_code=True)
# Text
result = model.system_one(
    state="The order arrived damaged yesterday. The customer has a receipt and asks for a replacement today.",
    questions={
        "route": {
            "type": "choice",
            "instructions": "Which team should handle this request?",
            "criteria": {
                "returns": "Refunds, replacements and damaged deliveries",
                "billing": "Payments, invoices and charges",
                "technical": "Product setup and faults",
            },
        },
        "receipt": {"type": "noul", "instructions": "Does the customer have a receipt?"},
        "urgency": {
            "type": "score",
            "instructions": "How urgent is this request?",
            "criteria": ["Routine", "Soon", "Today"],
        },
    },
)
print(json.dumps(result["answers"], indent=2))
# Text and images
result = model.system_one(
    state="The customer says the blender arrived cracked and attached the receipt.",
    images=["receipt.png"],  # local paths, http(s) URLs, PIL images or base64 data URLs
    questions={
        "on_receipt": {"type": "noul", "instructions": "Does the receipt list the blender?"},
        "payment": {
            "type": "choice",
            "instructions": "How was the order paid?",
            "criteria": {"card": None, "cash": None, "gift card": None},
        },
    },
)
print(json.dumps(result["answers"], indent=2))
```

`from_pretrained` takes `device` (default `cuda:0` when a GPU is visible) and `max_image_pixels` (see
[Images](#images)).

## Requests and answers

`system_one(state=..., questions={id: question, ...}, images=[...])` returns
`{"model", "answers": {id: answer}, "usage"}`. Every question sees the same state and images.

| `type` | `criteria` | answer |
| --- | --- | --- |
| `choice` | `{option: description or None}`, 1–255 options | `choice`, `probabilities` per option, `confidence` |
| `noul` | optional `{"true": ..., "false": ...}` descriptions | `noul`: the probability of yes / true |
| `score` | level descriptions, lowest first | `score` (expected level), `probabilities`, `legend`, `confidence` |

`instructions` is the question text. `state` can be a string or any JSON value. It is read as data, not as
instructions. Inputs are never truncated: a request over 131,072 tokens raises an error.

## Images

- **Size:** each image is resized, keeping its aspect ratio, to at most **1,638,400 pixels (1.6 MP, about
  1280 × 1280)** and at least 65,536. All the results above were measured at this setting, which is the default
  in the runtime and in `processor_config.json`.
- **Tokens:** one input token per 32 × 32 pixel patch, so about 1,600 for a 1.6 MP image and about 260 for
  512 × 512.
- **Order:** images go before the text, in the order given.
- **Lower cap:** for speed or memory, use `AutoModel.from_pretrained(..., max_image_pixels=...)`. Expect lower
  accuracy on fine detail such as charts, documents and small text. Caps above 1.6 MP are not validated.

## Architecture

Qwen3.8-27B vision-language backbone with a 255-option decision readout. Each question takes one forward pass, and its answer is read from the final prompt position.

**Training:** post-trained from Qwen3.8-27B in several stages: supervised fine-tuning on decisions across text and images, then reinforcement learning.

The model was trained with **bidirectional attention**: its full-attention layers see the whole prompt at once,
rather than only the tokens before each position. **It must be served the same way.** `trust_remote_code=True`
loads the bundled runtime (`matilda_decision_runtime.py`), which sets this up. Loading the weights as a plain causal backbone, or serving them in a causal engine, gives different and worse answers.

## License

Apache-2.0 ([LICENSE](LICENSE)). Built on [Qwen/Qwen3.8-27B](https://huggingface.co/Qwen/Qwen3.8-27B) (Apache-2.0).

	---
	pipeline_tag: zero-shot-classification
	license: apache-2.0
	base_model: Qwen/Qwen3.8-27B
	library_name: transformers
	tags:
	- decision-model
	- classification
	- system-one
	- multimodal
	- vision
	- maincode
	- matilda
	---

	# Matilda Decision v1

	Matilda Decision is a 27B multimodal decision model from Maincode. You give it an input (text or JSON,
	optionally with images) and the questions you need answered: pick one of several options, say yes or no, or rate
	on a scale. It answers them all in one call and returns a probability for every answer, without generating text.

	\| \| \|
	\| --- \| --- \|
	\| Parameters \| 26.1B, including the vision encoder \|
	\| Inputs \| Text or JSON, plus images (several per request, up to 1.6 MP each) \|
	\| Decision types \| Choice (up to 255 options) · Yes / No · Score \|
	\| License \| Apache-2.0 \|

	## Evaluation

	These are results on the public sets only, for now.

	### Text: Jev Decision Index 0.3, public suite

	All 140,178 public requests answered, none unsupported.

	\| Model \| Public index ↑ \| Knowledge & Reasoning \| Language \| Retrieval & Classification \| Tools & Automation \| Arts & Taste \|
	\| --- \| ---: \| ---: \| ---: \| ---: \| ---: \| ---: \|
	\| Matilda Decision v1 (27B) \| 65.38 \| 51.1 \| 71.3 \| 67.6 \| 84.6 \| 47.4 \|
	\| Torchcast Decision 27B \| 65.10 \| 46.7 \| 72.0 \| 67.5 \| 84.6 \| 54.4 \|
	\| Perplexity Decider v1.1 (27B) \| 62.25 \| 52.0 \| 67.5 \| 61.3 \| 78.9 \| 47.0 \|
	\| Jev \| 57.96 \| 53.9 \| 59.2 \| 55.4 \| 75.1 \| 39.1 \|

	<sub>Matilda Decision: our run with the official 0.3 kit. Others: Decision Index 0.3 board, public results
	(area scores computed from the board's per-benchmark results with the kit's own scoring).</sub>

	## Quickstart

	```bash
	pip install "transformers==5.17.0" torch torchvision pillow safetensors
	pip install flash-linear-attention # optional: fast GPU kernels for the linear-attention layers
	```

	```python
	import json

	from transformers import AutoModel

	model = AutoModel.from_pretrained("Maincode/matilda-decision-v1", trust_remote_code=True)

	# Text
	result = model.system_one(
	state="The order arrived damaged yesterday. The customer has a receipt and asks for a replacement today.",
	questions={
	"route": {
	"type": "choice",
	"instructions": "Which team should handle this request?",
	"criteria": {
	"returns": "Refunds, replacements and damaged deliveries",
	"billing": "Payments, invoices and charges",
	"technical": "Product setup and faults",
	},
	},
	"receipt": {"type": "noul", "instructions": "Does the customer have a receipt?"},
	"urgency": {
	"type": "score",
	"instructions": "How urgent is this request?",
	"criteria": ["Routine", "Soon", "Today"],
	},
	},
	)
	print(json.dumps(result["answers"], indent=2))

	# Text and images
	result = model.system_one(
	state="The customer says the blender arrived cracked and attached the receipt.",
	images=["receipt.png"], # local paths, http(s) URLs, PIL images or base64 data URLs
	questions={
	"on_receipt": {"type": "noul", "instructions": "Does the receipt list the blender?"},
	"payment": {
	"type": "choice",
	"instructions": "How was the order paid?",
	"criteria": {"card": None, "cash": None, "gift card": None},
	},
	},
	)
	print(json.dumps(result["answers"], indent=2))
	```

	`from_pretrained` takes `device` (default `cuda:0` when a GPU is visible) and `max_image_pixels` (see
	[Images](#images)).

	## Requests and answers

	`system_one(state=..., questions={id: question, ...}, images=[...])` returns
	`{"model", "answers": {id: answer}, "usage"}`. Every question sees the same state and images.

	\| `type` \| `criteria` \| answer \|
	\| --- \| --- \| --- \|
	\| `choice` \| `{option: description or None}`, 1–255 options \| `choice`, `probabilities` per option, `confidence` \|
	\| `noul` \| optional `{"true": ..., "false": ...}` descriptions \| `noul`: the probability of yes / true \|
	\| `score` \| level descriptions, lowest first \| `score` (expected level), `probabilities`, `legend`, `confidence` \|

	`instructions` is the question text. `state` can be a string or any JSON value. It is read as data, not as
	instructions. Inputs are never truncated: a request over 131,072 tokens raises an error.

	## Images

	- Size: each image is resized, keeping its aspect ratio, to at most **1,638,400 pixels (1.6 MP, about
	1280 × 1280)** and at least 65,536. All the results above were measured at this setting, which is the default
	in the runtime and in `processor_config.json`.
	- Tokens: one input token per 32 × 32 pixel patch, so about 1,600 for a 1.6 MP image and about 260 for
	512 × 512.
	- Order: images go before the text, in the order given.
	- Lower cap: for speed or memory, use `AutoModel.from_pretrained(..., max_image_pixels=...)`. Expect lower
	accuracy on fine detail such as charts, documents and small text. Caps above 1.6 MP are not validated.

	## Architecture

	Qwen3.8-27B vision-language backbone with a 255-option decision readout. Each question takes one forward pass, and its answer is read from the final prompt position.

	Training: post-trained from Qwen3.8-27B in several stages: supervised fine-tuning on decisions across text and images, then reinforcement learning.

	The model was trained with bidirectional attention: its full-attention layers see the whole prompt at once,
	rather than only the tokens before each position. It must be served the same way. `trust_remote_code=True`
	loads the bundled runtime (`matilda_decision_runtime.py`), which sets this up. Loading the weights as a plain causal backbone, or serving them in a causal engine, gives different and worse answers.

	## License

	Apache-2.0 ([LICENSE](LICENSE)). Built on [Qwen/Qwen3.8-27B](https://huggingface.co/Qwen/Qwen3.8-27B) (Apache-2.0).