MonkeyOCR v1.5 提升复杂文档解析能力,支持多页表格与嵌入图像的精准识别。
MonkeyOCR v1.5 Technical Report: Unlocking Robust Document Parsing for Complex Patterns
- 分两阶段处理:先布局与阅读顺序联合预测,再局部识别文本、公式和表格。
- 在 OmniDocBench v1.5 上超越 PPOCR-VL 与 MinerU 2.5,复杂场景下表现更鲁棒。
- 创新使用视觉一致性强化学习,无需人工标注即可提升表格结构准确率。
文档解析是文档智能的核心任务,支撑信息抽取、检索增强生成及自动化分析等应用。然而真实文档常包含多层次表格、嵌入图像或公式、跨页结构等复杂布局,现有 OCR 系统难以应对。本文提出 MonkeyOCR v1.5,一种统一的视觉语言框架,通过两阶段流水线提升布局理解与内容识别能力。第一阶段利用大型多模态模型联合预测布局与阅读顺序,借助视觉信息保证序列一致性;第二阶段在检测区域中进行文本、公式和表格的局部识别,保持高视觉保真度并减少误差传播。针对复杂表格结构,提出基于视觉一致性的强化学习方案,通过渲染对比评估识别质量,无需人工标注即可提升结构准确性。此外,引入图像解耦表格解析与类型引导表格合并两个专用模块,实现含嵌入图像表格的可靠解析及跨页/跨列表格重建。在 OmniDocBench v1.5 上的全面实验表明,MonkeyOCR v1.5 达到当前最佳性能,优于 PPOCR-VL 与 MinerU 2.5,且在视觉复杂场景中展现出卓越鲁棒性。
原文摘要 · Abstract (English)
Document parsing is a core task in document intelligence, supporting applications such as information extraction, retrieval-augmented generation, and automated document analysis. However, real-world documents often feature complex layouts with multi-level tables, embedded images or formulas, and cross-page structures, which remain challenging for existing OCR systems. We introduce MonkeyOCR v1.5, a unified vision-language framework that enhances both layout understanding and content recognition through a two-stage pipeline. The first stage employs a large multimodal model to jointly predict layout and reading order, leveraging visual information to ensure sequential consistency. The second stage performs localized recognition of text, formulas, and tables within detected regions, maintaining high visual fidelity while reducing error propagation. To address complex table structures, we propose a visual consistency-based reinforcement learning scheme that evaluates recognition quality via render-and-compare alignment, improving structural accuracy without manual annotations. Additionally, two specialized modules, Image-Decoupled Table Parsing and Type-Guided Table Merging, are introduced to enable reliable parsing of tables containing embedded images and reconstruction of tables crossing pages or columns. Comprehensive experiments on OmniDocBench v1.5 demonstrate that MonkeyOCR v1.5 achieves state-of-the-art performance, outperforming PPOCR-VL and MinerU 2.5 while showing exceptional robustness in visually complex document scenarios. A trial link can be found at https://github.com/Yuliang-Liu/MonkeyOCR .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。