Instructions to use vanta-research/scout-4b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use vanta-research/scout-4b with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="vanta-research/scout-4b")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("vanta-research/scout-4b")
model = AutoModelForMultimodalLM.from_pretrained("vanta-research/scout-4b", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use vanta-research/scout-4b with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf vanta-research/scout-4b:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf vanta-research/scout-4b:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf vanta-research/scout-4b:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf vanta-research/scout-4b:Q4_K_M

Build from source code

git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama serve -hf vanta-research/scout-4b:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama cli -hf vanta-research/scout-4b:Q4_K_M

Use Docker

docker model run hf.co/vanta-research/scout-4b:Q4_K_M

Llama new
LM Studio
Jan

vLLM

How to use vanta-research/scout-4b with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "vanta-research/scout-4b"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "vanta-research/scout-4b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/vanta-research/scout-4b:Q4_K_M

SGLang

How to use vanta-research/scout-4b with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "vanta-research/scout-4b" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "vanta-research/scout-4b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "vanta-research/scout-4b" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "vanta-research/scout-4b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Ollama
How to use vanta-research/scout-4b with Ollama:
```
ollama run hf.co/vanta-research/scout-4b:Q4_K_M
```
Unsloth Desktop
Docker Model Runner
How to use vanta-research/scout-4b with Docker Model Runner:
```
docker model run hf.co/vanta-research/scout-4b:Q4_K_M
```

Lemonade

How to use vanta-research/scout-4b with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull vanta-research/scout-4b:Q4_K_M

Run and chat with the model

lemonade run user.scout-4b-Q4_K_M

List all available models

lemonade list

Atomic Chat

scout-4b

Commit History

Feb 18

20:03
Update README.md

unmodeled-tyler

Verified signature
00ec0e6

Feb 17

00:47
Update README.md

unmodeled-tyler

Verified signature
566908f

Feb 10

04:18
Update README.md

unmodeled-tyler

Verified signature
bd40e1d

Feb 7

21:37
Update README.md

unmodeled-tyler

Verified signature
cc8afd2

Feb 4

20:25
Update README.md

unmodeled-tyler

Verified signature
b12d436

Feb 3

22:18
Update README.md

unmodeled-tyler

Verified signature
c504944

Feb 2

21:19
Update README.md

unmodeled-tyler

Verified signature
2edd223

Feb 1

21:44
Update README.md

unmodeled-tyler

Verified signature
cb5cd4d

Jan 31

19:46
Update README.md

unmodeled-tyler

Verified signature
1fa8b56

Jan 30

19:35
Update README.md

unmodeled-tyler

Verified signature
5a89e5b

Jan 29

22:52
Update README.md

unmodeled-tyler

Verified signature
85c5f84

Jan 28

17:55
Update README.md

unmodeled-tyler

Verified signature
100129e

Jan 27

23:49
Update README.md

unmodeled-tyler

Verified signature
cba6928

Jan 26

03:39
Update README.md

unmodeled-tyler

Verified signature
fdd5bae

Jan 24

18:35
Update README.md

unmodeled-tyler

Verified signature
a6a256f

Jan 23

19:16
Update README.md

unmodeled-tyler

Verified signature
d557b99

Jan 21

22:27
Update README.md

unmodeled-tyler

Verified signature
569c56b

Jan 20

23:51
Update README.md

unmodeled-tyler

Verified signature
4179371

Jan 19

16:51
Update README.md

unmodeled-tyler

Verified signature
e545ab4

Jan 18

01:04
Update README.md

unmodeled-tyler

Verified signature
08ee52a

Jan 15

22:39
Update README.md

unmodeled-tyler

Verified signature
aa306f9

Jan 14

23:12
Update README.md

unmodeled-tyler

Verified signature
2598b2d

Jan 13

20:26
Update README.md

unmodeled-tyler

Verified signature
79e73c2

Jan 12

01:12
Update README.md

unmodeled-tyler

Verified signature
adfb1ea

Jan 11

00:44
Update README.md

unmodeled-tyler

Verified signature
f1fb3b2

Jan 6

19:35
Update README.md

unmodeled-tyler

Verified signature
ad5a738

Jan 5

21:00
Update README.md

unmodeled-tyler

Verified signature
526e1b0

Jan 3

21:07
Update README.md

unmodeled-tyler

Verified signature
2340a39

Jan 2

17:52
Update README.md

unmodeled-tyler

Verified signature
55f6f23

Dec 31, 2025

21:29
Update README.md

unmodeled-tyler

Verified signature
9c41837

Dec 19, 2025

20:25
Update README.md

unmodeled-tyler

Verified signature
491819b
00:23
Update README.md

unmodeled-tyler

Verified signature
820b3e6

Dec 16, 2025

20:35
Update README.md

unmodeled-tyler

Verified signature
c440c8d

Dec 13, 2025

06:08
Update README.md

unmodeled-tyler

Verified signature
f6c231d

Dec 8, 2025

21:10
Update README.md

unmodeled-tyler

Verified signature
0ca57a1

Dec 6, 2025

20:42
Update README.md

unmodeled-tyler

Verified signature
9f657b2

Dec 5, 2025

23:25
Update README.md

unmodeled-tyler

Verified signature
b0f3d7c

Dec 3, 2025

19:42
Update README.md

unmodeled-tyler

Verified signature
693eab0
08:20
Update README.md

unmodeled-tyler

Verified signature
d042808

Dec 1, 2025

00:44
Update README.md

unmodeled-tyler

Verified signature
f4a88cf

Nov 26, 2025

01:06
Update README.md

unmodeled-tyler

Verified signature
be2d915

Nov 24, 2025

22:14
Update README.md

unmodeled-tyler

Verified signature
7cfa18b
03:34
Update README.md

unmodeled-tyler

Verified signature
5e40c82
03:16
Update README.md

unmodeled-tyler

Verified signature
7abafb4

Nov 23, 2025

22:55
Update README.md

unmodeled-tyler

Verified signature
954b20e
20:28
Update README.md

unmodeled-tyler

Verified signature
69d6394
20:27
Update README.md

unmodeled-tyler

Verified signature
cf527db
20:16
Update README.md

unmodeled-tyler

Verified signature
5ef6930
04:50
Update README.md

unmodeled-tyler

Verified signature
ea97214

Nov 21, 2025

23:12
Update README.md

unmodeled-tyler

Verified signature
6ad65f0

Commit History

Feb 18

Update README.md

Feb 17

Update README.md

Feb 10

Update README.md

Feb 7

Update README.md

Feb 4

Update README.md

Feb 3

Update README.md

Feb 2

Update README.md

Feb 1

Update README.md

Jan 31

Update README.md

Jan 30

Update README.md

Jan 29

Update README.md

Jan 28

Update README.md

Jan 27

Update README.md

Jan 26

Update README.md

Jan 24

Update README.md

Jan 23

Update README.md

Jan 21

Update README.md

Jan 20

Update README.md

Jan 19

Update README.md

Jan 18

Update README.md

Jan 15

Update README.md

Jan 14

Update README.md

Jan 13

Update README.md

Jan 12

Update README.md

Jan 11

Update README.md

Jan 6

Update README.md

Jan 5

Update README.md

Jan 3

Update README.md

Jan 2

Update README.md

Dec 31, 2025

Update README.md

Dec 19, 2025

Update README.md

Update README.md

Dec 16, 2025

Update README.md

Dec 13, 2025

Update README.md

Dec 8, 2025

Update README.md

Dec 6, 2025

Update README.md

Dec 5, 2025

Update README.md

Dec 3, 2025

Update README.md

Update README.md

Dec 1, 2025

Update README.md

Nov 26, 2025