用图神经网络分析政务文档布局,提升文本块分类准确率。
Benchmarking Graph Neural Networks for Document Layout Analysis in Public Affairs
- 构建邻近图与全连接图,融合文本视觉特征自动提取节点表示。
- 双分支GNN在k近邻图上表现最优,部分来源准确率超越基线。
- 适用于政务类数字文档的细粒度布局分析,适合信息抽取场景。
由于数字原生PDF中文本与非文本元素排列多样,且文本元数据不精确,文档布局自动分析仍具挑战。本文针对此类文档中的文本块细粒度布局分类任务,基准测试多种图神经网络(GNN)架构。提出两种图构建方式:k近邻图和全连接图,并通过预训练文本与视觉模型生成节点特征,避免人工特征工程。评估三种实验框架:单模态(文本或视觉)、拼接多模态、双分支多模态。对比四种基础GNN模型与基线。实验基于包含20多个来源(如地方与国家级官方公报)的丰富数据集,共37,000份PDF文档,总计441,000页。结果表明,图卷积网络GraphSAGE在双分支配置下结合k近邻图时达到最高类别及整体准确率,部分来源显著优于基线。研究验证了局部布局关系与多模态融合通过GNN对原生数字文档布局分析的重要性。
原文摘要 · Abstract (English)
The automatic analysis of document layouts in digital-born PDF documents remains a challenging problem due to the heterogeneous arrangement of textual and nontextual elements and the imprecision of the textual metadata in the Portable Document Format. In this work, we benchmark Graph Neural Network (GNN) architectures for the task of fine-grained layout classification of text blocks from digital native documents. We introduce two graph construction structures: a k-closest-neighbor graph and a fully connected graph, and generate node features via pre-trained text and vision models, thus avoiding manual feature engineering. Three experimental frameworks are evaluated: single-modality (text or visual), concatenated multimodal, and dual-branch multimodal. We evaluated four foundational GNN models and compared them with the baseline. Our experiments are specifically conducted on a rich dataset of public affairs documents that includes more than 20 sources (e.g., regional and national-level official gazettes), 37K PDF documents, with 441K pages in total. Our results demonstrate that GraphSAGE operating on the k-closest-neighbor graph in a dual-branch configuration achieves the highest per-class and overall accuracy, outperforming the baseline in some sources. These findings confirm the importance of local layout relationships and multimodal fusion exploited through GNNs for the analysis of native digital document layouts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。