GGR
Collection
Models and data for Gaze Guided Reasoner โข 22 items โข Updated
How to use gsarch/Qwen3-VL-8B-Fix-Subset-RL with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("image-text-to-text", model="gsarch/Qwen3-VL-8B-Fix-Subset-RL")
messages = [
{
"role": "user",
"content": [
{"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
{"type": "text", "text": "What animal is on the candy?"}
]
},
]
pipe(text=messages) # pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM
processor = AutoProcessor.from_pretrained("gsarch/Qwen3-VL-8B-Fix-Subset-RL")
model = AutoModelForMultimodalLM.from_pretrained("gsarch/Qwen3-VL-8B-Fix-Subset-RL", device_map="auto")
messages = [
{
"role": "user",
"content": [
{"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
{"type": "text", "text": "What animal is on the candy?"}
]
},
]
inputs = processor.apply_chat_template(
messages,
add_generation_prompt=True,
tokenize=True,
return_dict=True,
return_tensors="pt",
).to(model.device)
outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))How to use gsarch/Qwen3-VL-8B-Fix-Subset-RL with vLLM:
# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "gsarch/Qwen3-VL-8B-Fix-Subset-RL"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "gsarch/Qwen3-VL-8B-Fix-Subset-RL",
"messages": [
{
"role": "user",
"content": [
{
"type": "text",
"text": "Describe this image in one sentence."
},
{
"type": "image_url",
"image_url": {
"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
}
}
]
}
]
}'docker model run hf.co/gsarch/Qwen3-VL-8B-Fix-Subset-RL
How to use gsarch/Qwen3-VL-8B-Fix-Subset-RL with SGLang:
# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
--model-path "gsarch/Qwen3-VL-8B-Fix-Subset-RL" \
--host 0.0.0.0 \
--port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "gsarch/Qwen3-VL-8B-Fix-Subset-RL",
"messages": [
{
"role": "user",
"content": [
{
"type": "text",
"text": "Describe this image in one sentence."
},
{
"type": "image_url",
"image_url": {
"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
}
}
]
}
]
}'docker run --gpus all \
--shm-size 32g \
-p 30000:30000 \
-v ~/.cache/huggingface:/root/.cache/huggingface \
--env "HF_TOKEN=<secret>" \
--ipc=host \
lmsysorg/sglang:latest \
python3 -m sglang.launch_server \
--model-path "gsarch/Qwen3-VL-8B-Fix-Subset-RL" \
--host 0.0.0.0 \
--port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "gsarch/Qwen3-VL-8B-Fix-Subset-RL",
"messages": [
{
"role": "user",
"content": [
{
"type": "text",
"text": "Describe this image in one sentence."
},
{
"type": "image_url",
"image_url": {
"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
}
}
]
}
]
}'How to use gsarch/Qwen3-VL-8B-Fix-Subset-RL with Docker Model Runner:
docker model run hf.co/gsarch/Qwen3-VL-8B-Fix-Subset-RL
The Fix. Subset visual reasoning condition further trained with reinforcement learning. The condition's system prompt is built into the chat template.
from PIL import Image
from transformers import AutoModelForImageTextToText, AutoProcessor
model_id = "gsarch/Qwen3-VL-8B-Fix-Subset-RL"
processor = AutoProcessor.from_pretrained(model_id)
model = AutoModelForImageTextToText.from_pretrained(
model_id, dtype="auto", device_map="auto"
)
image = Image.open("image.jpg").convert("RGB")
messages = [{"role": "user", "content": [
{"type": "image", "image": image},
{"type": "text", "text": "What is shown in this image?"},
]}]
inputs = processor.apply_chat_template(
messages, add_generation_prompt=True, tokenize=True,
return_dict=True, return_tensors="pt",
).to(model.device)
output = model.generate(**inputs, max_new_tokens=2048, do_sample=False)
print(processor.decode(output[0, inputs["input_ids"].shape[-1]:], skip_special_tokens=True))
Base model
Qwen/Qwen3-VL-8B-Instruct