Dolphin-v2统一解析文档,能处理拍摄和数字文档,支持细粒度内容提取。
Dolphin-v2: Universal Document Parsing via Scalable Anchor Prompting
- 分两阶段:先分类文档类型,再按类型选择整体或分块解析
- 在OmniDocBench上提升14.78分,拍摄文档错误率降低91%
- 可识别代码块并保留缩进,适合需要精确结构的场景
文档解析因视觉语言模型(VLM)提升OCR能力而备受关注。然而,该领域仍由数十种专用模型割裂,用户需复杂选型,限制系统扩展性。现有两阶段方法依赖轴对齐边界框进行版面检测,难以应对扭曲或拍摄文档。为此,我们提出Dolphin-v2,一种两阶段文档图像解析模型,显著优于原始Dolphin。第一阶段联合完成文档类型分类(数字生成与拍摄)及版面分析;对数字文档,进一步实现细粒度元素检测与阅读顺序预测。第二阶段采用混合解析策略:拍摄文档作为整体页面进行全图理解以应对几何畸变,数字文档则基于检测到的版面锚点进行元素级并行解析,实现高效内容提取。相比原版Dolphin,Dolphin-v2引入多项关键改进:(1)通过页面级理解增强拍摄文档鲁棒性;(2)实现21类细粒度元素检测,支持作者信息、元数据等语义属性提取;(3)具备代码块识别与缩进保留能力,现有系统普遍缺失。在DocPTBench、OmniDocBench及自建RealDoc-160基准上全面评估,结果表明:在挑战性强的OmniDocBench上提升14.78分,拍摄文档错误率降低91%,同时通过并行处理保持高效推理。
原文摘要 · Abstract (English)
Document parsing has garnered widespread attention as vision-language models (VLMs) advance OCR capabilities. However, the field remains fragmented across dozens of specialized models with varying strengths, forcing users to navigate complex model selection and limiting system scalability. Moreover, existing two-stage approaches depend on axis-aligned bounding boxes for layout detection, failing to handle distorted or photographed documents effectively. To this end, we present Dolphin-v2, a two-stage document image parsing model that substantially improves upon the original Dolphin. In the first stage, Dolphin-v2 jointly performs document type classification (digital-born versus photographed) alongside layout analysis. For digital-born documents, it conducts finer-grained element detection with reading order prediction. In the second stage, we employ a hybrid parsing strategy: photographed documents are parsed holistically as complete pages to handle geometric distortions, while digital-born documents undergo element-wise parallel parsing guided by the detected layout anchors, enabling efficient content extraction. Compared with the original Dolphin, Dolphin-v2 introduces several crucial enhancements: (1) robust parsing of photographed documents via holistic page-level understanding, (2) finer-grained element detection (21 categories) with semantic attribute extraction such as author information and document metadata, and (3) code block recognition with indentation preservation, which existing systems typically lack. Comprehensive evaluations are conducted on DocPTBench, OmniDocBench, and our self-constructed RealDoc-160 benchmark. The results demonstrate substantial improvements: +14.78 points overall on the challenging OmniDocBench and 91% error reduction on photographed documents, while maintaining efficient inference through parallel processing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。