Visual Scaffolding: Toward Native Multimodal Reasoning
Paper • 2610.25247 • Published
A task-specific checkpoint for Visual Scaffolding. The model requests visual evidence during reasoning and uses retrieved image features to continue its trace. This checkpoint handles Burden Counting in NMR-Bench. The Path Tracing checkpoint is released separately.
📄 Paper: Visual Scaffolding: Toward Native Multimodal Reasoning
Built on Qwen3-VL-4B-Thinking, the repository contains a complete model checkpoint, processor, tokenizer, and Visual Scaffolding configuration.
Use Python 3.12 and a CUDA-compatible PyTorch installation.
git clone https://github.com/GeoX-Lab/VisualScaffolding.git
cd VisualScaffolding
pip install -e '.[inference]'
pip install huggingface_hub
hf download ShaoRun/nmr-bench --repo-type dataset --local-dir benchmark
hf download ShaoRun/vscaffold-4b-burden-counting --local-dir checkpoints/burden_counting
python -m visual_scaffolding evaluate \
--task burden_counting \
--benchmark benchmark \
--checkpoint checkpoints/burden_counting \
--device cuda:0 \
--output outputs/counting.jsonl
The evaluator writes predictions and a scoring summary. For single-image inference, see the GitHub repository.
Released under Apache 2.0. See LICENSE and NOTICE.md. Checkpoint details are in model_info.json.
Base model
Qwen/Qwen3-VL-4B-Thinking