arXiv:2601.07620cs.CV2026-01被引 1

不依赖OCR,用视觉结构分析文档布局,更准更省

PARL: Position-Aware Relation Learning Network for Document Layout Analysis

  • 用位置感知注意力建模元素间空间关系
  • 在DocLayNet上达新纪录,超多模态模型表现
  • 参数量仅65M,效率远高于大型多模态模型

文档布局分析旨在检测和分类扫描或数字文档中的结构元素(如标题、表格、图表)。现有方法通常依赖高质量的光学字符识别(OCR)将视觉特征与文本信息融合,但这带来两大问题:文本识别错误的传播以及巨大的计算开销,限制了多模态方法的鲁棒性和实用性。相反,我们提出不依赖文本-视觉融合,而是深入理解文档的内在视觉结构。为此,我们设计了PARL(Position-Aware Relation Learning Network),一种无需OCR的纯视觉框架,通过位置敏感性和关系结构建模布局。首先,引入双向空间位置引导可变形注意力模块,将元素间的显式位置依赖直接嵌入视觉特征。其次,设计图精炼分类器(GRC),通过动态构建的布局图建模上下文关系来优化预测。大量实验表明,PARL达到领先水平,在DocLayNet上建立纯视觉方法新基准,并显著超越强多模态模型在M6Doc上的表现。关键的是,PARL(65M参数)极为高效,参数量仅为大型多模态模型(256M)的约四分之一,证明复杂视觉结构建模既高效又鲁棒。

原文摘要 · Abstract (English)

Document layout analysis aims to detect and categorize structural elements (e.g., titles, tables, figures) in scanned or digital documents. Popular methods often rely on high-quality Optical Character Recognition (OCR) to merge visual features with extracted text. This dependency introduces two major drawbacks: propagation of text recognition errors and substantial computational overhead, limiting the robustness and practical applicability of multimodal approaches. In contrast to the prevailing multimodal trend, we argue that effective layout analysis depends not on text-visual fusion, but on a deep understanding of documents' intrinsic visual structure. To this end, we propose PARL (Position-Aware Relation Learning Network), a novel OCR-free, vision-only framework that models layout through positional sensitivity and relational structure. Specifically, we first introduce a Bidirectional Spatial Position-Guided Deformable Attention module to embed explicit positional dependencies among layout elements directly into visual features. Second, we design a Graph Refinement Classifier (GRC) to refine predictions by modeling contextual relationships through a dynamically constructed layout graph. Extensive experiments show PARL achieves state-of-the-art results. It establishes a new benchmark for vision-only methods on DocLayNet and, notably, surpasses even strong multimodal models on M6Doc. Crucially, PARL (65M) is highly efficient, using roughly four times fewer parameters than large multimodal models (256M), demonstrating that sophisticated visual structure modeling can be both more efficient and robust than multimodal fusion.

文档分析视觉模型无OCR

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。