PolyOCR-Venus: Unified OCR Foundation Models for Text-Centric Visual Intelligence
Abstract
Optical Character Recognition (OCR) is evolving from plain-text transcription toward general visual intelligence, requiring models to recognize, localize, and reason over textual information in complex visual environments. However, existing OCR systems often excel at only some tasks and struggle to balance recognition, parsing, and reasoning across scenarios. In this report, we present PolyOCR, a family of unified OCR foundation models of varying scales. PolyOCR combines a shared instruction-following framework with a large-scale data engine that converts heterogeneous visual resources into quality-verified OCR supervision. We introduce Competence-Guided Policy Optimization, which combines verifier-based Group Relative Policy Optimization with on-policy distillation through sample-wise routing based on teacher reliability and the teacher--student competence gap. We also introduce OCRBench v2.1, our revision of OCRBench v2 with manually verified annotation corrections and task-aligned scoring metrics. Extensive experiments across OCRBench v2.1, CC-OCR, in-house KIE Benchmark, OmniDocBench v1.6 and MDPBench demonstrate that PolyOCR achieves state-of-the-art or highly competitive performance.
Community
Meet PolyOCR-Venus, a family of OCR models for reading, locating, parsing, and reasoning over text in images. (。•̀ᴗ-)✧
🔍 A shared interface for diverse OCR tasks. The 2B and 9B models bring text recognition, grounding, document parsing, information extraction, and OCR reasoning into one instruction-following framework.
🧠 Learn from the teacher when its guidance helps. Our Competence-Guided Policy Optimization (CGPO) combines GRPO with on-policy distillation, adjusting teacher supervision per sample based on teacher reliability and the evolving teacher–student competence gap.
📊 Strong results at modest model sizes. PolyOCR-9B scores 80.42 / 78.37 on OCRBench v2.1 (English / Chinese) and 82.43 on CC-OCR across the three evaluated tracks, excluding multilingual OCR. A dedicated 2.7B multilingual variant reaches 87.0 on MDPBench.
🛠️ Evaluation gets attention too. OCRBench v2.1 revises 2,449 samples with manual verification and introduces task-aligned scoring for more reliable evaluation.
Get this paper in your agent:
hf papers read 2609.37712 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 1
Collections including this paper 0
No Collection including this paper