Instructions to use infly/Infinity-Parser2-Pro with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use infly/Infinity-Parser2-Pro with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="infly/Infinity-Parser2-Pro")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("infly/Infinity-Parser2-Pro")
model = AutoModelForMultimodalLM.from_pretrained("infly/Infinity-Parser2-Pro", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use infly/Infinity-Parser2-Pro with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "infly/Infinity-Parser2-Pro"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "infly/Infinity-Parser2-Pro",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/infly/Infinity-Parser2-Pro

SGLang

How to use infly/Infinity-Parser2-Pro with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "infly/Infinity-Parser2-Pro" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "infly/Infinity-Parser2-Pro",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "infly/Infinity-Parser2-Pro" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "infly/Infinity-Parser2-Pro",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use infly/Infinity-Parser2-Pro with Docker Model Runner:
```
docker model run hf.co/infly/Infinity-Parser2-Pro
```

Infinity-Parser2-Pro

Commit History

May 11

12:01
Update README.md

zuminghuang

Verified signature
cdbbc6f
11:53
Upload 2 files

zuminghuang

Verified signature
0f6f375
10:04
Upload 8 files

zuminghuang

Verified signature
2015ac4
09:56
Upload 5 files

zuminghuang

Verified signature
d72ae75
09:48
Upload 6 files

zuminghuang

Verified signature
e0f49ca

Apr 28

12:44
Update README.md

zuminghuang

Verified signature
72b3342

Apr 20

04:12
Update README.md

zuminghuang

Verified signature
0b82703

Apr 15

13:11
Update README.md

zuminghuang

Verified signature
afaf1a3
13:10
Update README.md

zuminghuang

Verified signature
fc763a6
06:36
Update README.md

zuminghuang

Verified signature
a9ac0e9
05:28
Update README.md

zuminghuang

Verified signature
cade246
05:24
Update README.md

zuminghuang

Verified signature
e35b4c7
03:28
Update README.md

zuminghuang

Verified signature
b641725
02:21
Update README.md

zuminghuang

Verified signature
10d15d5
02:16
Update README.md

zuminghuang

Verified signature
d89f3db
02:09
Update README.md

zuminghuang

Verified signature
4a56f82

Apr 14

14:59
Update README.md

zuminghuang

Verified signature
b62196d
14:43
Update README.md

zuminghuang

Verified signature
f5b1684
14:34
Update README.md

zuminghuang

Verified signature
43a9a56

Apr 11

04:42
Update README.md

zuminghuang

Verified signature
e13e7a8

Apr 10

01:37
Upload model-00007-of-00015.safetensors

zuminghuang

Verified signature
cc73766

Apr 9

14:42
Update README.md

zuminghuang

Verified signature
6a4987d
14:38
Update README.md

zuminghuang

Verified signature
0023127
14:36
Upload document_parsing_performance_evaluation.png

zuminghuang

Verified signature
5fa8d14
13:43
Upload model-00006-of-00015.safetensors

zuminghuang

Verified signature
f900f2e
11:27
Upload 4 files

zuminghuang

Verified signature
f10bd62
11:22
Upload 3 files

zuminghuang

Verified signature
2f13fb3
11:19
Upload 2 files

zuminghuang

Verified signature
1c5b52b
11:16
Upload model-00001-of-00015.safetensors

zuminghuang

Verified signature
dcf84c3
10:17
Update README.md

zuminghuang

Verified signature
dc196c8
10:15
Update README.md

zuminghuang

Verified signature
09db769
10:14
Upload model-00015-of-00015.safetensors

zuminghuang

Verified signature
607e41a
10:01
Update README.md

zuminghuang

Verified signature
0ae7110
09:13
Upload model-00003-of-00015.safetensors

zuminghuang

Verified signature
7a08a4e
09:04
Upload 2 files

zuminghuang

Verified signature
26bc564
07:20
Upload 6 files

zuminghuang

Verified signature
913e162
03:50
Update README.md

zuminghuang

Verified signature
a1f46dc
03:15
Update README.md

zuminghuang

Verified signature
12fa14f
03:14
Update .eval_results/olmocrbench.yaml

zuminghuang

Verified signature
e597b7d

Apr 8

12:55
Upload .eval_results/olmocrbench.yaml

zuminghuang

Verified signature
c131fc3
12:48
Update README.md

zuminghuang

Verified signature
28db656
12:47
Update README.md

zuminghuang

Verified signature
38405e1
12:45
Upload assets/logo.png

zuminghuang

Verified signature
deff836
12:44
Update README.md

zuminghuang

Verified signature
91332be
12:28
initial commit

zuminghuang

Verified signature
106e84c

Commit History

May 11

Update README.md

Upload 2 files

Upload 8 files

Upload 5 files

Upload 6 files

Apr 28

Update README.md

Apr 20

Update README.md

Apr 15

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Apr 14

Update README.md

Update README.md

Update README.md

Apr 11

Update README.md

Apr 10

Upload model-00007-of-00015.safetensors

Apr 9

Update README.md

Update README.md

Upload document_parsing_performance_evaluation.png

Upload model-00006-of-00015.safetensors

Upload 4 files

Upload 3 files

Upload 2 files

Upload model-00001-of-00015.safetensors

Update README.md

Update README.md

Upload model-00015-of-00015.safetensors

Update README.md

Upload model-00003-of-00015.safetensors

Upload 2 files

Upload 6 files

Update README.md

Update README.md

Update .eval_results/olmocrbench.yaml

Apr 8

Upload .eval_results/olmocrbench.yaml

Update README.md

Update README.md

Upload assets/logo.png

Update README.md

initial commit