Instructions to use internlm/Intern-S2-Mobius with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use internlm/Intern-S2-Mobius with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="internlm/Intern-S2-Mobius", trust_remote_code=True)
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoModelForImageTextToText
model = AutoModelForImageTextToText.from_pretrained("internlm/Intern-S2-Mobius", trust_remote_code=True, device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use internlm/Intern-S2-Mobius with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "internlm/Intern-S2-Mobius"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "internlm/Intern-S2-Mobius",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/internlm/Intern-S2-Mobius

SGLang

How to use internlm/Intern-S2-Mobius with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "internlm/Intern-S2-Mobius" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "internlm/Intern-S2-Mobius",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "internlm/Intern-S2-Mobius" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "internlm/Intern-S2-Mobius",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use internlm/Intern-S2-Mobius with Docker Model Runner:
```
docker model run hf.co/internlm/Intern-S2-Mobius
```

Intern-S2-Mobius

Commit History

Fix typo (#2)

87c9148

Messi-Hua

xianbao commited on about 9 hours ago

Update README

f1b3420
verified

Messi-Hua commited on about 11 hours ago

Delete assets

9e8b4a8
verified

Messi-Hua commited on about 11 hours ago

Upload assets

a2cd0b9
verified

Messi-Hua commited on about 11 hours ago

Update README

5d39493
verified

Messi-Hua commited on about 11 hours ago

Delete deployment_guide.md

4635db3
verified

Messi-Hua commited on about 14 hours ago

Update README

fe6e6ff
verified

Messi-Hua commited on about 14 hours ago

Update README and deployment guide

d7f1d4c
verified

Messi-Hua commited on about 15 hours ago

Update README and deployment guide

c0b0941
verified

Messi-Hua commited on about 17 hours ago

Update deployment guide

b7bc552
verified

Messi-Hua commited on about 18 hours ago

Update deployment guide

d4311b6
verified

Messi-Hua commited on about 18 hours ago

Update README

4efe000
verified

Messi-Hua commited on about 19 hours ago

Update README, deployment guide, and figures

fa3de07
verified

Messi-Hua commited on 1 day ago

Upload Intern-S2-Mobius model

2fd8ae7
verified

Messi-Hua commited on 1 day ago

initial commit

06cd0e0
verified

Qi Zhang commited on 7 days ago

Commit History

Fix typo (#2) 87c9148

Update README f1b3420 verified

Delete assets 9e8b4a8 verified

Upload assets a2cd0b9 verified

Update README 5d39493 verified

Delete deployment_guide.md 4635db3 verified

Update README fe6e6ff verified

Update README and deployment guide d7f1d4c verified

Update README and deployment guide c0b0941 verified

Update deployment guide b7bc552 verified

Update deployment guide d4311b6 verified

Update README 4efe000 verified

Update README, deployment guide, and figures fa3de07 verified

Upload Intern-S2-Mobius model 2fd8ae7 verified

initial commit 06cd0e0 verified

Fix typo (#2)

87c9148

Update README

f1b3420
verified

Delete assets

9e8b4a8
verified

Upload assets

a2cd0b9
verified

Update README

5d39493
verified

Delete deployment_guide.md

4635db3
verified

Update README

fe6e6ff
verified

Update README and deployment guide

d7f1d4c
verified

Update README and deployment guide

c0b0941
verified

Update deployment guide

b7bc552
verified

Update deployment guide

d4311b6
verified

Update README

4efe000
verified

Update README, deployment guide, and figures

fa3de07
verified

Upload Intern-S2-Mobius model

2fd8ae7
verified

initial commit

06cd0e0
verified