arXiv:2601.07483cs.CV2026-01ACL被引 1

针对文档阅读顺序检测中的难点区域学习不足问题,提出焦点优化方法。

FocalOrder: Focal Preference Optimization for Reading Order Detection

  • 通过动态识别难学布局过渡区域,聚焦困难样本训练。
  • 在OmniDocBench和Comp-HRDoc上达到新最优,小模型超越大模型。
  • 适合需要精准理解复杂文档结构的场景,如合同、报表分析。

阅读顺序检测是文档理解的基础。现有方法多依赖均匀监督,隐含假设布局区域难度分布恒定。本文揭示关键缺陷:位置差异性——模型对确定性的起始与结束区域掌握良好,但在复杂中间部分性能急剧下降。这源于标准训练中大量简单模式掩盖了难布局的学习信号。为此,提出FocalOrder框架,基于焦点偏好优化(FPO)。该方法利用指数移动平均机制自适应发现难学过渡区域,并引入难度校准的成对排序目标,确保全局逻辑一致性。大量实验表明,FocalOrder在OmniDocBench v1.0和Comp-HRDoc上达到新最优。其紧凑模型不仅优于同类专用基线,更显著超越大规模通用视觉语言模型。结果证明,将优化对齐文档内在结构模糊性,对掌握复杂文档结构至关重要。

原文摘要 · Abstract (English)

Reading order detection is the foundation of document understanding. Most existing methods rely on uniform supervision, implicitly assuming a constant difficulty distribution across layout regions. In this work, we challenge this assumption by revealing a critical flaw: \textbf{Positional Disparity}, a phenomenon where models demonstrate mastery over the deterministic start and end regions but suffer a performance collapse in the complex intermediate sections. This degradation arises because standard training allows the massive volume of easy patterns to drown out the learning signals from difficult layouts. To address this, we propose \textbf{FocalOrder}, a framework driven by \textbf{Focal Preference Optimization (FPO)}. Specifically, FocalOrder employs adaptive difficulty discovery with exponential moving average mechanism to dynamically pinpoint hard-to-learn transitions, while introducing a difficulty-calibrated pairwise ranking objective to enforce global logical consistency. Extensive experiments demonstrate that FocalOrder establishes new state-of-the-art results on OmniDocBench v1.0 and Comp-HRDoc. Our compact model not only outperforms competitive specialized baselines but also significantly surpasses large-scale general VLMs. These results demonstrate that aligning the optimization with intrinsic structural ambiguity of documents is critical for mastering complex document structures.

文档理解阅读顺序焦点优化布局分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。