arXiv:2601.05470cs.CVcs.CL2026-01

提升文档理解模型的阅读顺序感知与文本注意力,增强关键信息提取效果。

ROAP: A Reading-Order and Attention-Prior Pipeline for Optimizing Layout Transformers in Key Information Extraction

  • 构建阅读顺序感知的相对位置偏置,优化注意力分布。
  • 在FUNSD和CORD数据集上显著提升LayoutLMv3等模型性能。
  • 适合需要高精度文档布局分析的工业级应用。

视觉丰富文档理解(VrDU)中多模态Transformer的效能受两大固有局限制约:缺乏对逻辑阅读顺序的显式建模,以及视觉标记干扰导致文本语义注意力被稀释。本文提出ROAP,一种轻量级、与架构无关的流水线,可在不修改预训练主干的情况下优化布局Transformer中的注意力分布。该方法首先利用自适应XY间隙树(AXG-Tree)从复杂版面中稳健提取分层阅读序列,并通过阅读顺序感知的相对位置偏置(RO-RPB)将其融入注意力机制;此外,引入文本标记子块注意力先验(TT-Prior),自适应抑制视觉噪声并增强细粒度文本-文本交互。在FUNSD和CORD基准上的大量实验表明,ROAP持续提升主流主干模型(如LayoutLMv3和GeoLayoutLM)的性能。结果证实,显式建模阅读逻辑并调节模态干扰对鲁棒文档理解至关重要,为复杂版面分析提供了可扩展解决方案。代码将开源于https://github.com/KevinYuLei/ROAP。

原文摘要 · Abstract (English)

The efficacy of Multimodal Transformers in visually-rich document understanding (VrDU) is critically constrained by two inherent limitations: the lack of explicit modeling for logical reading order and the interference of visual tokens that dilutes attention on textual semantics. To address these challenges, this paper presents ROAP, a lightweight and architecture-agnostic pipeline designed to optimize attention distributions in Layout Transformers without altering their pre-trained backbones. The proposed pipeline first employs an Adaptive-XY-Gap (AXG-Tree) to robustly extract hierarchical reading sequences from complex layouts. These sequences are then integrated into the attention mechanism via a Reading-Order-Aware Relative Position Bias (RO-RPB). Furthermore, a Textual-Token Sub-block Attention Prior (TT-Prior) is introduced to adaptively suppress visual noise and enhance fine-grained text-text interactions. Extensive experiments on the FUNSD and CORD benchmarks demonstrate that ROAP consistently improves the performance of representative backbones, including LayoutLMv3 and GeoLayoutLM. These findings confirm that explicitly modeling reading logic and regulating modality interference are critical for robust document understanding, offering a scalable solution for complex layout analysis. The implementation code will be released at https://github.com/KevinYuLei/ROAP.

文档理解注意力机制布局建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。