Instructions to use internlm/AdvancedMathBench-AutoVerifier with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use internlm/AdvancedMathBench-AutoVerifier with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="internlm/AdvancedMathBench-AutoVerifier")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("internlm/AdvancedMathBench-AutoVerifier")
model = AutoModelForMultimodalLM.from_pretrained("internlm/AdvancedMathBench-AutoVerifier", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use internlm/AdvancedMathBench-AutoVerifier with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "internlm/AdvancedMathBench-AutoVerifier"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "internlm/AdvancedMathBench-AutoVerifier",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/internlm/AdvancedMathBench-AutoVerifier

SGLang

How to use internlm/AdvancedMathBench-AutoVerifier with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "internlm/AdvancedMathBench-AutoVerifier" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "internlm/AdvancedMathBench-AutoVerifier",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "internlm/AdvancedMathBench-AutoVerifier" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "internlm/AdvancedMathBench-AutoVerifier",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use internlm/AdvancedMathBench-AutoVerifier with Docker Model Runner:
```
docker model run hf.co/internlm/AdvancedMathBench-AutoVerifier
```

AdvancedMathBench-AutoVerifier

File size: 6,005 Bytes

d4a1f95

bbedc3fda3305820b977265f01b8619d87570a6739de3a5582c3464840f1e57a  LICENSE
a4aee8afcf2e0711942cf848899be66016f8d14a889ff9ede07bca099c28f715  chat_template.jinja
2848b0e6ac95267352d439a41d6efba7951a5870ce9a0d1daffb4b4d1d079840  config.json
4f25002776b741773666203dcea8f54619f177ace3ae483d311102092a4658e0  generation_config.json
3bd640ba6d8da8f5844f3548b7e2184fc664dd670e1447e425a48dbaaad1ef43  merges.txt
6dc5cb409e57c647a07900539977f4459988da9aae18c713e78c040f9e59e670  model-language-0001-fused-save_rank0.safetensors
7f74cda2afc0b6cc5f5aee61243d4ea19ec0ef8892f1ce15d3d75f44965ed093  model-language-0001-fused-save_rank1.safetensors
e7e59ac9144d6ff7234fbfa019f7453a0fd46d5cfa83ea24f1a2d69ea0b69da7  model-language-0001-fused-save_rank10.safetensors
d308b89f5a235fa5c4b56d54983f27d52f8f41c41896f3e25ed5d10708a901ab  model-language-0001-fused-save_rank11.safetensors
2e65f0d33478f1d87a882acd4f6ee631ffa13a02c04507408777def4117bc791  model-language-0001-fused-save_rank12.safetensors
5b7616b8ebebcdaafcac6ecf74c3803441a71df622bf688b8e89fd5665f7bac5  model-language-0001-fused-save_rank13.safetensors
40277357e610e556ba2435737123bca4801ec37888eb1eaff7a95d06723f68ef  model-language-0001-fused-save_rank14.safetensors
5f3238f4e8a27f33ecfcd15452a97c363a895453f7e9c966041102ab878dbbba  model-language-0001-fused-save_rank15.safetensors
ffd0b63509989f3b107572451fb9d721a4a06429d71f80953534d7ecb5dc2a63  model-language-0001-fused-save_rank2.safetensors
8a8ad9eb11e3686e45c7f075544f2f674c643855bcbed3be1c509976b97ef555  model-language-0001-fused-save_rank3.safetensors
1607938699926513b4cbc1ebf6d2f6c8a30bc2d0177a683054bd9b15b86e62ad  model-language-0001-fused-save_rank4.safetensors
7884f2544f54dd507ad0303bfe50879fba1633749ef9e29721e3c2a71ad9aac0  model-language-0001-fused-save_rank5.safetensors
ce2035b780b3fe2f4cc932faab39342053557ba04e0180cae42299c53f34d6cd  model-language-0001-fused-save_rank6.safetensors
ca9f85c24bb6d3946d18ea29b764930297f14fecebe110a449d9a5943a0817ed  model-language-0001-fused-save_rank7.safetensors
bd39af2b019444105f9bf5af150e22b0b4871d7b3c651e36548cd1223af52166  model-language-0001-fused-save_rank8.safetensors
ee9797ad6fd78d6c81dac053f757b914537297c79eaaaacffb614c2633c2b15a  model-language-0001-fused-save_rank9.safetensors
9981fb59074c1a0d4bb3ae339f769746b2e7e5080b91f30e91a9308d61be659e  model-language-0001-others-save_rank0.safetensors
cb7fa1e4bd79b049d8cb214f5c68a8cb956b3f05c5183a11a806544031b0f235  model-language-0002-others-save_rank0.safetensors
42b10a711a10996d73560708adee75f198bfa6eefb0451d248a3ec3a5958489e  model-language-0003-others-save_rank0.safetensors
4e580d5dc2e5466279982a26df9398a4e0e1a51e83e0b9cade6c69b95ceb32c7  model-language-0004-others-save_rank0.safetensors
fc265d902e8c955469c6f71b68379fc73e24b3069ba863dd6fa1a92c6c35d02d  model-language-0005-others-save_rank0.safetensors
94ba85645b6373792cd77878502a0c4f332afe4bea3a0fd110782eaf527044ee  model-language-0006-others-save_rank0.safetensors
74c5a4a4f1a6c7c67b998efcc7a78464f5aa9311a8a2cd31811afa9b0928e5bb  model-language-0007-others-save_rank0.safetensors
9624740aad902bf6e510ce750275057e77bd1e52ea9a7d7736bb8a75ee18ac42  model-language-0008-others-save_rank0.safetensors
13ab1770ade382328d894f8f4ac00b47d189d9fed83be733731a95d11eb31706  model-language-0009-others-save_rank0.safetensors
0d158718e05cc09e72e4d81cef437a549abcbc9c13618b75b8912cefadf56c56  model-language-0010-others-save_rank0.safetensors
f1c4bceffcaaccec6d435636f09fb7d161cc24e6ff8a03f5a57fda1e161e87a0  model-language-0011-others-save_rank0.safetensors
2bb36f2a6c1854c8166fd3c7d4c49d3601151572ce9d00fa5cbc77aabd5e6b0b  model-language-0012-others-save_rank0.safetensors
0eeb09bf430b2be9db8498c68f7dd00156eda974de87e6edc78477c453e7a6c3  model-language-0013-others-save_rank0.safetensors
771ec8dcaad6fa681dc64734f6bb28db4b3facd02db456325a99e6467be4d8e9  model-language-0014-others-save_rank0.safetensors
aa6859905f1e45242a8d274dab76b15aa5c96637fd88aaf959dee6b5b855ddcc  model-language-0015-others-save_rank0.safetensors
c80667bf0680ac6a31e04826f188747f1e348d4f31637d251ec82e7c8cf58880  model-language-0016-others-save_rank0.safetensors
ffcb3d069d1b92dd0e98ed1150cc1e55dbb6ea73bbd5cfe752cb7eb8886461da  model-language-0017-others-save_rank0.safetensors
98d95974f2e17cdff6575d35f3367fe9618ec56cf384abcde161771769095f83  model-language-0018-others-save_rank0.safetensors
160b6114d8607073b20000fc665ca6548e9a08facc00c234ed5457056d185175  model-language-0019-others-save_rank0.safetensors
d075ed8040661d4f9586ab7de09220a6484dec1ad3776210478ea7697577a626  model-language-0020-others-save_rank0.safetensors
10a6c734ad7ab213d3d12d0404cee6df31f7364b8ce179d1d1c034ef5ec8dd26  model-language-0021-others-save_rank0.safetensors
0c94ebd2a5ea3a3496253262c5f3c5cf7235d30a0ea84b7b4a8fb0b9018d68df  model-language-0022-others-save_rank0.safetensors
7b38702ff3948f711782b3975d189e3cb67ca1eedbc53e9be13398016afedd50  model-projector-0001-others-save_rank0.safetensors
1fb153b047f5c3debfffc5efa74e853bbf04278c6268f1eb5b883b6a250100c9  model-vision-0001-others-save_rank0.safetensors
05124f9e7a8566158eb83934bc2d3a59700640b9296aed654fbe1d2eda6ed39a  model.safetensors.index.json
27225450ac9c6529872ee1924fcb0962ff5634834f817040f444118116f4e516  preprocessor_config.json
9c6c4c51d1c410cf5563bea65da6a80d06f42ab2abf091a9f7caca5a03fc9aec  special_tokens_map.json
ad0ecddabf936ad205382ebc7dc87755eb711c2833ebd590179188a7fb2716ac  tokenization_interns1.py
5f9e4d4901a92b997e463c1f46055088b6cca5ca61a6522d1b9f64c4bb81cb42  tokenizer.json
1144f52f86f3ca5a29940d69b037e508c05a89e6eedbe42bea641e226b20dbe0  tokenizer_PROT.model
fba1c97da0353ccbffd368ae78e311ccbc762aa5ba74f9aff8bf2ab363c4d37d  tokenizer_SMILES.model
58fc8bfb2af3dfe936a13dad8a9cb28dab7850b70b358db19605d867c133fb35  tokenizer_XNA.model
f2a82034eae0bfaa63d19d9648d88af0b99fdc0914de1bfbbb4621801e2d3e74  tokenizer_config.json
7768af27c1fafa9cc9011c1dc20067e03f8915e03b63504550e11d5066986d13  video_preprocessor_config.json
657191b77e1d51b28521773221d4121bfe4844900147f7818499e0347d8c66f6  vocab.json