arXiv:2502.02501cs.CV2025-02ICLR被引 6

用图结构分析文档布局,让模型像人一样理解内容间空间与逻辑关系。

Graph-based Document Structure Analysis

  • 将文档元素及其关系建模为图结构,实现整体化理解。
  • 在8万张文档图像上构建413万条关系标注,支持多任务分析。
  • 提出新模型DRGG,在图任务中达到57.6% [email protected],适合文档智能理解研究者。

阅读文档时,快速浏览版面布局是初步理解的重要步骤。传统文档布局分析(DLA)方法仅能进行浅层解析,侧重基础元素检测,难以捕捉元素间的细微空间与逻辑关系,限制了模型对文档的渐进式深入理解。为此,本文提出新型图结构文档结构分析(gDSA)任务:模型不仅需检测文档元素,还需生成以图结构表示的空间与逻辑关系,实现更整体、直观的理解。为此,我们构建了包含8万张文档图像和413万条关系标注的GraphDoc数据集,支持阅读顺序推断、层级结构分析及复杂元素关系推理等多任务训练。进一步提出文档关系图生成器(DRGG),在该新任务与数据集上取得57.6% [email protected]的基准性能。我们期望这一图式表示能推动文档结构分析与理解的创新进展。数据集与代码将公开于 https://yufanchen96.github.io/projects/GraphDoc。

原文摘要 · Abstract (English)

When reading a document, glancing at the spatial layout of a document is an initial step to understand it roughly. Traditional document layout analysis (DLA) methods, however, offer only a superficial parsing of documents, focusing on basic instance detection and often failing to capture the nuanced spatial and logical relations between instances. These limitations hinder DLA-based models from achieving a gradually deeper comprehension akin to human reading. In this work, we propose a novel graph-based Document Structure Analysis (gDSA) task. This task requires that model not only detects document elements but also generates spatial and logical relations in form of a graph structure, allowing to understand documents in a holistic and intuitive manner. For this new task, we construct a relation graph-based document structure analysis dataset (GraphDoc) with 80K document images and 4.13M relation annotations, enabling training models to complete multiple tasks like reading order, hierarchical structures analysis, and complex inter-element relation inference. Furthermore, a document relation graph generator (DRGG) is proposed to address the gDSA task, which achieves performance with 57.6% at [email protected] for a strong benchmark baseline on this novel task and dataset. We hope this graphical representation of document structure can mark an innovative advancement in document structure analysis and understanding. The new dataset and code will be made publicly available at https://yufanchen96.github.io/projects/GraphDoc.

文档分析图神经网络结构理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。