InSight-doc: Agentic Visual Perception for Long-Document Understanding
Abstract
InSight-doc adaptively allocates visual resolution during reasoning to improve long-document understanding while reducing latency and hallucinations.
Long-document understanding often requires reasoning over many visually rich pages, making inference costly and prone to context rot. In this work, we propose InSight-doc, an agentic visual perception framework that treats visual resolution as an adaptive reasoning-time resource. InSight-doc starts from low resolution and selectively zooms into high-resolution regions for finer evidence, without relying on any external retriever. To train such an agent, we construct an active-perception corpus of 17.9K high-quality SFT examples with region-level zoom-in trajectories, accompanied by 19.2K hard RL examples. Through SFT+RL, InSight-doc-8B improves the baseline by 4.3--16.4 accuracy points over document VQA benchmarks. On long documents, it reduces hallucination by more than 40% and inference latency by 41%--68% while maintaining an accuracy lead. Our code, datasets, and model are released at https://github.com/m-Just/InSight-doc .
Community
Check out our demo at https://vaynexie.github.io/insight-doc-demo-display/demo_display.html (๐ฌ replay) and https://huggingface.co/spaces/leoyu112211/insight-doc-online-demo (๐ live) !
Get this paper in your agent:
hf papers read 2608.10628 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash