通过粗到精视觉处理,提升文档解析效率与精度。
Boosting Document Parsing Efficiency and Performance with Coarse-to-Fine Visual Processing
- 采用粗到精架构,聚焦语义相关区域,抑制冗余背景。
- 仅用少量视觉标记实现领先性能,推理速度更快。
- 适合需要高效文档理解的工业场景应用。
文档解析是细粒度任务,图像分辨率显著影响性能。尽管基于视觉语言模型的先进方法依赖高分辨率输入以提升效果,但会导致视觉标记数量呈二次增长,计算成本大幅上升。我们归因于文档图像中存在大量冗余视觉区域(如背景)。为此,提出PaddleOCR-VL,一种新颖的粗到精架构,聚焦语义相关区域并抑制冗余部分,从而兼顾效率与性能。具体地,引入轻量级有效区域聚焦模块(VRFM),利用定位与上下文关系预测能力识别有效视觉标记。随后,设计并训练一个0.9B参数的小型但强大的视觉语言模型(PaddleOCR-VL-0.9B),在VRFM输出引导下执行精细识别,避免直接处理整张大图。大量实验表明,PaddleOCR-VL在页面级解析与元素级识别上均达当前最优性能,显著优于现有方案,且在顶尖VLM中具备竞争力,推理快速,使用视觉标记和参数更少,验证了目标导向粗到精解析的有效性。代码与模型已公开于https://github.com/PaddlePaddle/PaddleOCR。
原文摘要 · Abstract (English)
Document parsing is a fine-grained task where image resolution significantly impacts performance. While advanced research leveraging vision-language models benefits from high-resolution input to boost model performance, this often leads to a quadratic increase in the number of vision tokens and significantly raises computational costs. We attribute this inefficiency to substantial visual regions redundancy in document images, like background. To tackle this, we propose PaddleOCR-VL, a novel coarse-to-fine architecture that focuses on semantically relevant regions while suppressing redundant ones, thereby improving both efficiency and performance. Specifically, we introduce a lightweight Valid Region Focus Module (VRFM) which leverages localization and contextual relationship prediction capabilities to identify valid vision tokens. Subsequently, we design and train a compact yet powerful 0.9B vision-language model (PaddleOCR-VL-0.9B) to perform detailed recognition, guided by VRFM outputs to avoid direct processing of the entire large image. Extensive experiments demonstrate that PaddleOCR-VL achieves state-of-the-art performance in both page-level parsing and element-level recognition. It significantly outperforms existing solutions, exhibits strong competitiveness against top-tier VLMs, and delivers fast inference while utilizing substantially fewer vision tokens and parameters, highlighting the effectiveness of targeted coarse-to-fine parsing for accurate and efficient document understanding. The source code and models are publicly available at https://github.com/PaddlePaddle/PaddleOCR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。