Instructions to use FINAL-Bench/Darwin-35B-A3B-Opus with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use FINAL-Bench/Darwin-35B-A3B-Opus with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="FINAL-Bench/Darwin-35B-A3B-Opus")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("FINAL-Bench/Darwin-35B-A3B-Opus")
model = AutoModelForMultimodalLM.from_pretrained("FINAL-Bench/Darwin-35B-A3B-Opus", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use FINAL-Bench/Darwin-35B-A3B-Opus with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "FINAL-Bench/Darwin-35B-A3B-Opus"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "FINAL-Bench/Darwin-35B-A3B-Opus",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/FINAL-Bench/Darwin-35B-A3B-Opus

SGLang

How to use FINAL-Bench/Darwin-35B-A3B-Opus with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "FINAL-Bench/Darwin-35B-A3B-Opus" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "FINAL-Bench/Darwin-35B-A3B-Opus",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "FINAL-Bench/Darwin-35B-A3B-Opus" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "FINAL-Bench/Darwin-35B-A3B-Opus",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use FINAL-Bench/Darwin-35B-A3B-Opus with Docker Model Runner:
```
docker model run hf.co/FINAL-Bench/Darwin-35B-A3B-Opus
```

Darwin-35B-A3B-Opus

Commit History

Jul 23

04:00
Upload README.md with huggingface_hub

SeaWolf-AI

Verified signature
7e8c953
03:32
Upload README.md with huggingface_hub

SeaWolf-AI

Verified signature
2599f27

Jun 3

06:06
remove: delete GPQA model-index from README (score unconfirmed)

SeaWolf-AI

Verified signature
ecf5edf
06:06
remove: delete gpqa_diamond.yaml (score unconfirmed)

SeaWolf-AI

Verified signature
04d7546
05:54
fix: change base_model_relation to merge for leaderboard filter compatibility

SeaWolf-AI

Verified signature
b960083
05:53
fix: remove incorrect datasets field (not trained on GPQA, only evaluated)

SeaWolf-AI

Verified signature
17d430d
05:44
feat: add .eval_results/gpqa_diamond.yaml for GPQA dataset indexing

SeaWolf-AI

Verified signature
d55ab7b
05:40
fix: add datasets: Idavidrein/gpqa for dataset page indexing

SeaWolf-AI

Verified signature
9fd3883
05:37
fix: correct model-index YAML for Idavidrein/gpqa indexing

SeaWolf-AI

Verified signature
89a3841

May 15

02:20
Update README.md

SeaWolf-AI

Verified signature
d2f2833

Apr 11

03:09
Update README.md

SeaWolf-AI

Verified signature
7e4ce0b

Apr 8

04:03
Update README.md

SeaWolf-AI

Verified signature
7080d9a
00:54
Update README.md

SeaWolf-AI

Verified signature
cce05cb
00:14
Update README.md

SeaWolf-AI

Verified signature
f5ab754

Apr 4

03:51
Update README.md

SeaWolf-AI

Verified signature
9852417

Apr 3

19:16
Update README.md

SeaWolf-AI

Verified signature
9e001c6

Apr 2

15:36
Update README.md

SeaWolf-AI

Verified signature
666553b
07:11
Update README.md

SeaWolf-AI

Verified signature
6781294
06:59
Update tokenizer_config.json

SeaWolf-AI

Verified signature
a6fc8a9

Mar 31

09:21
Update README.md

SeaWolf-AI

Verified signature
31c167d
09:06
Update README.md

SeaWolf-AI

Verified signature
23229eb
09:03
Update README.md

SeaWolf-AI

Verified signature
7da6016
09:00
Update README.md

SeaWolf-AI

Verified signature
804a7d4
08:57
Update README.md

SeaWolf-AI

Verified signature
ff98718
08:54
Rename newplot (28).png to c1.png

SeaWolf-AI

Verified signature
6c033ce
08:54
Upload newplot (28).png

SeaWolf-AI

Verified signature
e608e48
08:49
Update README.md

SeaWolf-AI

Verified signature
f7108bd
08:48
Rename newplot (26).png to a3.png

SeaWolf-AI

Verified signature
fc1863b
08:48
Rename newplot (25).png to a2.png

SeaWolf-AI

Verified signature
91f7216
08:48
Rename newplot (24).png to a1.png

SeaWolf-AI

Verified signature
ecc409a
08:47
Rename newplot (23).png to m3.png

SeaWolf-AI

Verified signature
d829bcc
08:47
Rename newplot (22).png to m2.png

SeaWolf-AI

Verified signature
fd711ac
08:47
Rename newplot (21).png to m1.png

SeaWolf-AI

Verified signature
d80e68d
08:46
Rename newplot (20).png to f3.png

SeaWolf-AI

Verified signature
2886c2b
08:46
Rename newplot (19).png to f2.png

SeaWolf-AI

Verified signature
1bc27a7
08:46
Rename newplot (18).png to f1.png

SeaWolf-AI

Verified signature
7b84d59
08:44
Upload 9 files

SeaWolf-AI

Verified signature
c575ee2
07:33
Update README.md

SeaWolf-AI

Verified signature
6d4b273
07:33
Update README.md

SeaWolf-AI

Verified signature
8bc759a
07:31
Upload qwen.png

SeaWolf-AI

Verified signature
7143c1f
07:30
Update README.md

SeaWolf-AI

Verified signature
779dd5f
06:15
Update README.md

SeaWolf-AI

Verified signature
235513d
06:06
Upload info.png

SeaWolf-AI

Verified signature
adf3ad0
05:19
Update README.md

SeaWolf-AI

Verified signature
8b52264
01:55
Upload folder using huggingface_hub

SeaWolf-AI

Verified signature
805fb74
01:54
initial commit

SeaWolf-AI

Verified signature
336181c

Commit History

Jul 23

Upload README.md with huggingface_hub

Upload README.md with huggingface_hub

Jun 3

remove: delete GPQA model-index from README (score unconfirmed)

remove: delete gpqa_diamond.yaml (score unconfirmed)

fix: change base_model_relation to merge for leaderboard filter compatibility

fix: remove incorrect datasets field (not trained on GPQA, only evaluated)

feat: add .eval_results/gpqa_diamond.yaml for GPQA dataset indexing

fix: add datasets: Idavidrein/gpqa for dataset page indexing

fix: correct model-index YAML for Idavidrein/gpqa indexing

May 15

Update README.md

Apr 11

Update README.md

Apr 8

Update README.md

Update README.md

Update README.md

Apr 4

Update README.md

Apr 3

Update README.md

Apr 2

Update README.md

Update README.md

Update tokenizer_config.json

Mar 31

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Rename newplot (28).png to c1.png

Upload newplot (28).png

Update README.md

Rename newplot (26).png to a3.png

Rename newplot (25).png to a2.png

Rename newplot (24).png to a1.png

Rename newplot (23).png to m3.png

Rename newplot (22).png to m2.png

Rename newplot (21).png to m1.png

Rename newplot (20).png to f3.png

Rename newplot (19).png to f2.png

Rename newplot (18).png to f1.png

Upload 9 files

Update README.md

Update README.md

Upload qwen.png

Update README.md

Update README.md

Upload info.png

Update README.md

Upload folder using huggingface_hub

initial commit