arXiv:2608.04424cs.CV2026-08

用视觉锚点让模型像人一样推理文档的结构与语义。

Thinking with Anchors: Grounded and Efficient Document Reasoning

论文配图:Thinking with Anchors: Grounded and Efficient Document Reasoning
图 1 · 摘自论文原文
  • 将文本块、图像实体等设为可复用的视觉锚点,统一表示文档元素。
  • 在DocCount基准上,顶尖模型仍难以完成密集计数任务。
  • 适合研究文档智能推理与多模态理解的开发者和研究员。

现有文档理解评测主要关注页面元素定位,但真实场景需要模型联合推理区域语义、空间关系与视觉结构。我们提出ADOPD 2026,是ADOPD的推理导向扩展,将页面分解转化为空间化的文档理解。该数据集在继承ADOPD 2024的页面锚点基础上,增加了人工清理的描述、语义标签及生成的链式思考(CoT)轨迹,并将其与文档区域对齐。不将框、掩码、标签视为独立监督信号,而是将文本块、视觉实体、语义标签、边界框与多边形掩码统一为共享的视觉锚点词汇表。该表示支持三项能力:一、区域级语义标注要求模型结合上下文与局部外观识别元素类型,揭示布局基准常忽略的长尾语义错误;二、统一的视觉-语言对齐可同时生成文本区域与视觉实体及其坐标或轮廓,将检测与分割输出转为可复用于下游推理系统的结构化锚点;三、当前最先进模型在基于ADOPD 2026构建的DocCount基准上仍表现不佳,凸显‘以锚点思考’管道在文档语义理解中的必要性。通过将页面分解连接到可验证的视觉锚点推理,ADOPD 2026提供了一个超越定位任务的文档智能框架。

原文摘要 · Abstract (English)

Existing document understanding benchmarks have largely focused on locating page elements, yet real-world document intelligence requires models to reason jointly about region semantics, spatial relations, and visual structure. We present ADOPD 2026, a reasoning-oriented extension of ADOPD that turns page decomposition into spatially grounded document understanding. ADOPD 2026 enriches page anchors inherited from ADOPD 2024 dataset with human-cleaned captions, semantic tags, and generated chain-of-thought (CoT) traces grounded to document regions. Instead of treating boxes, masks, and tags as independent supervision signals, we cast text blocks, visual entities, semantic labels, bounding boxes, and polygon masks as a shared vocabulary of visual anchors. This representation supports three connected capabilities. First, region-level semantic tagging asks models to identify document element types from both page context and local appearance, revealing long-tail semantic failures that standard layout benchmarks often hide. Second, unified vision-language grounding generates text regions and visual entities together with coordinates or polygonal outlines, transforming detection and segmentation outputs into structured anchors that can be reused by downstream reasoning systems. Third, current state-of-the-art models still struggle with dense counting tasks evaluated on DocCount, a benchmark derived from ADOPD 2026, highlighting the need for the Thinking-with-Anchors pipeline in document semantic understanding. By connecting page decomposition to verifiable visual-anchor reasoning, ADOPD 2026 provides a task framework that moves document understanding beyond localization toward anchor-grounded document intelligence.

文档理解视觉锚点推理增强多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。