Instructions to use GroundingPI/GroundAnything-VLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use GroundingPI/GroundAnything-VLM with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="GroundingPI/GroundAnything-VLM", trust_remote_code=True)
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("GroundingPI/GroundAnything-VLM", trust_remote_code=True, device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use GroundingPI/GroundAnything-VLM with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "GroundingPI/GroundAnything-VLM"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "GroundingPI/GroundAnything-VLM",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/GroundingPI/GroundAnything-VLM

SGLang

How to use GroundingPI/GroundAnything-VLM with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "GroundingPI/GroundAnything-VLM" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "GroundingPI/GroundAnything-VLM",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "GroundingPI/GroundAnything-VLM" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "GroundingPI/GroundAnything-VLM",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use GroundingPI/GroundAnything-VLM with Docker Model Runner:
```
docker model run hf.co/GroundingPI/GroundAnything-VLM
```

GroundAnything-VLM

Commit History

Publish demo and project links, revised citations, and simplified quick links

fec9737
verified

Skywalker0410 commited on 7 days ago

Update main demo video and prepared cover

61cf85b
verified

Skywalker0410 commited on 7 days ago

Keep inline title logos compact without image margins (#3)

da7d6cd

GroundingPI

Skywalker0410 commited on 8 days ago

Simplify model card layout and evaluation; clarify license scope (#2)

40af09a

GroundingPI

Skywalker0410 commited on 8 days ago

Publish model weights, paper figures, and complete model card (#1)

d603a32

GroundingPI

Skywalker0410 commited on 8 days ago

initial commit

0078ab6
verified

GroundingPI commited on 10 days ago

Commit History

Publish demo and project links, revised citations, and simplified quick links fec9737 verified

Update main demo video and prepared cover 61cf85b verified

Keep inline title logos compact without image margins (#3) da7d6cd

Simplify model card layout and evaluation; clarify license scope (#2) 40af09a

Publish model weights, paper figures, and complete model card (#1) d603a32

initial commit 0078ab6 verified

Publish demo and project links, revised citations, and simplified quick links

fec9737
verified

Update main demo video and prepared cover

61cf85b
verified

Keep inline title logos compact without image margins (#3)

da7d6cd

Simplify model card layout and evaluation; clarify license scope (#2)

40af09a

Publish model weights, paper figures, and complete model card (#1)

d603a32

initial commit

0078ab6
verified