arXiv:2503.15893cs.CV2025-03中稿 · Pattern Recognitio…被引 3

统一关系预测框架,让模型一次搞定文档层级结构分析的多个任务。

UniHDSA: A Unified Relation Prediction Approach for Hierarchical Document Structure Analysis

  • 将文档结构分析各子任务统一为关系预测问题,用单一模块处理多任务。
  • 在Comp-HRDoc和DocLayNet上均达到领先或竞争力表现,全任务均衡提升。
  • 适合需要高效处理复杂文档结构的系统开发者与研究者使用。

文档结构分析对理解文档的物理布局与逻辑结构至关重要,支持信息检索、摘要生成与知识提取等应用。层次化文档结构分析(HDSA)旨在还原使用分层模板的文档软件所创建的层级结构。以往研究主要采用两种方法:一是孤立处理子任务如表格检测或阅读顺序预测;二是采用多分支统一框架分别应对不同任务。本文提出一种统一的关系预测方法UniHDSA,将各类HDSA子任务视为关系预测问题,并将关系标签统一映射到同一标签空间。这使得单个关系预测模块可同时处理页面级与文档级结构分析任务。基于Transformer架构构建端到端系统,实验表明该方法在层次化文档分析基准Comp-HRDoc上达到当前最优性能,在大规模文档布局数据集DocLayNet上也取得有竞争力的结果,全面验证了方法优势。Comp-HRDoc基准与UniHDSA配置已公开于https://github.com/microsoft/CompHRDoc。

原文摘要 · Abstract (English)

Document structure analysis, aka document layout analysis, is crucial for understanding both the physical layout and logical structure of documents, serving information retrieval, document summarization, knowledge extraction, etc. Hierarchical Document Structure Analysis (HDSA) specifically aims to restore the hierarchical structure of documents created using authoring software with hierarchical schemas. Previous research has primarily followed two approaches: one focuses on tackling specific subtasks of HDSA in isolation, such as table detection or reading order prediction, while the other adopts a unified framework that uses multiple branches or modules, each designed to address a distinct task. In this work, we propose a unified relation prediction approach for HDSA, called UniHDSA, which treats various HDSA sub-tasks as relation prediction problems and consolidates relation prediction labels into a unified label space. This allows a single relation prediction module to handle multiple tasks simultaneously, whether at a page-level or document-level structure analysis. To validate the effectiveness of UniHDSA, we develop a multimodal end-to-end system based on Transformer architectures. Extensive experimental results demonstrate that our approach achieves state-of-the-art performance on a hierarchical document structure analysis benchmark, Comp-HRDoc, and competitive results on a large-scale document layout analysis dataset, DocLayNet, effectively illustrating the superiority of our method across all sub-tasks. The Comp-HRDoc benchmark and UniHDSA's configurations are publicly available at https://github.com/microsoft/CompHRDoc.

文档分析关系预测多任务学习Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。