Instructions to use GroundingPI/GroundAnything-VLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use GroundingPI/GroundAnything-VLM with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="GroundingPI/GroundAnything-VLM", trust_remote_code=True)
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("GroundingPI/GroundAnything-VLM", trust_remote_code=True, device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use GroundingPI/GroundAnything-VLM with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "GroundingPI/GroundAnything-VLM"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "GroundingPI/GroundAnything-VLM",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/GroundingPI/GroundAnything-VLM

SGLang

How to use GroundingPI/GroundAnything-VLM with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "GroundingPI/GroundAnything-VLM" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "GroundingPI/GroundAnything-VLM",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "GroundingPI/GroundAnything-VLM" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "GroundingPI/GroundAnything-VLM",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use GroundingPI/GroundAnything-VLM with Docker Model Runner:
```
docker model run hf.co/GroundingPI/GroundAnything-VLM
```

GroundAnything-VLM

Commit History

Remove teaser spacing and pin tightly cropped artwork

0c9e66a
verified

Skywalker0410 commited on 9 days ago

Respect PDF crop box to remove teaser white margins

85a0044
verified

Skywalker0410 commited on 9 days ago

Point model card to the new teaser

9433ab8
verified

Skywalker0410 commited on 9 days ago

Replace teaser with updated ICLR artwork

df01c8f
verified

Skywalker0410 commited on 9 days ago

Update main demo video and prepared cover (#4)

8bf4186

GroundingPI

Skywalker0410 commited on 9 days ago

Keep inline title logos compact without image margins (#3)

da7d6cd

GroundingPI

Skywalker0410 commited on 10 days ago

Simplify model card layout and evaluation; clarify license scope (#2)

40af09a

GroundingPI

Skywalker0410 commited on 10 days ago

Publish model weights, paper figures, and complete model card (#1)

d603a32

GroundingPI

Skywalker0410 commited on 10 days ago

initial commit

0078ab6
verified

GroundingPI commited on 12 days ago

Commit History

Remove teaser spacing and pin tightly cropped artwork 0c9e66a verified

Respect PDF crop box to remove teaser white margins 85a0044 verified

Point model card to the new teaser 9433ab8 verified

Replace teaser with updated ICLR artwork df01c8f verified

Update main demo video and prepared cover (#4) 8bf4186

Keep inline title logos compact without image margins (#3) da7d6cd

Simplify model card layout and evaluation; clarify license scope (#2) 40af09a

Publish model weights, paper figures, and complete model card (#1) d603a32

initial commit 0078ab6 verified

Remove teaser spacing and pin tightly cropped artwork

0c9e66a
verified

Respect PDF crop box to remove teaser white margins

85a0044
verified

Point model card to the new teaser

9433ab8
verified

Replace teaser with updated ICLR artwork

df01c8f
verified

Update main demo video and prepared cover (#4)

8bf4186

Keep inline title logos compact without image margins (#3)

da7d6cd

Simplify model card layout and evaluation; clarify license scope (#2)

40af09a

Publish model weights, paper figures, and complete model card (#1)

d603a32

initial commit

0078ab6
verified