让OCR只读需要的内容,提升文档问答效率
AgenticOCR: Parsing Only What You Need for Efficient Retrieval-Augmented Generation
- 根据查询动态提取文档关键区域,避免全页处理
- 在长文档问答中达到专家级准确率,减少幻觉
- 适合需要高效处理复杂文档的RAG系统使用者
视觉文档的检索增强生成(RAG)面临处理复杂文档(如财务报告)的挑战。传统按页切块的方法会将整页内容传递给生成器,造成冗余信息过多,干扰注意力机制并稀释关键证据。同时,在有限视觉标记预算下压缩信息丰富的页面,进一步增加幻觉风险。为此,我们提出AgenticOCR,一种动态解析范式,将光学字符识别(OCR)从静态全文处理转变为查询驱动的按需提取系统。通过自主分析文档布局,以‘图像思考’方式识别兴趣区域,并仅在必要时解压视觉标记,有效打破检索粒度与固定页级分块的绑定。AgenticOCR可作为视觉文档RAG架构的第三核心模块,与嵌入和重排序模块协同工作。实验表明,该方法显著提升了视觉RAG系统的效率与准确性,在长文档理解任务中达到专家级表现。代码与模型已开源于https://github.com/OpenDataLab/AgenticOCR。
原文摘要 · Abstract (English)
The expansion of retrieval-augmented generation (RAG) into multimodal domains has intensified the challenge for processing complex visual documents, such as financial reports. While page-level chunking and retrieval is a natural starting point, it creates a critical bottleneck: delivering entire pages to the generator introduces excessive extraneous context. This not only overloads the generator's attention mechanism but also dilutes the most salient evidence. Moreover, compressing these information-rich pages into a limited visual token budget further increases the risk of hallucinations. To address this, we introduce AgenticOCR, a dynamic parsing paradigm that transforms optical character recognition (OCR) from a static, full-text process into a query-driven, on-demand extraction system. By autonomously analyzing document layout in a "thinking with images" manner, AgenticOCR identifies and selectively recognizes regions of interest. This approach performs on-demand decompression of visual tokens precisely where needed, effectively decoupling retrieval granularity from rigid page-level chunking. AgenticOCR has the potential to serve as the "third building block" of the visual document RAG stack, operating alongside and enhancing standard Embedding and Reranking modules. Experimental results demonstrate that AgenticOCR improves both the efficiency and accuracy of visual RAG systems, achieving expert-level performance in long document understanding. Code and models are available at https://github.com/OpenDataLab/AgenticOCR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。