arXiv:2412.03590cs.CLcs.AI2024-12被引 12

用图神经网络生成逼真文档布局,提升AI模型训练数据质量。

Enhancing Document AI Data Generation Through Graph-Based Synthetic Layouts

  • 将文档元素建模为图节点,通过图神经网络生成布局。
  • 在分类、命名实体识别任务中性能显著优于传统方法。
  • 适合需要高质量合成数据的文档智能研究者使用。

文档智能模型的发展受限于高质量标注数据的获取,主要因数据隐私、数据稀缺及人工标注成本高昂。传统合成数据生成方法(如文本和图像增强)虽能增加数据多样性,但难以捕捉真实文档中的复杂版式结构。本文提出一种基于图神经网络(GNN)的合成文档版式生成新方法:将文本块、图片、表格等文档元素表示为图节点,其空间关系作为边,训练GNN生成具有结构一致性和语义连贯性的逼真布局。该框架在文档分类、命名实体识别(NER)和信息抽取任务上验证有效,显著提升模型性能。同时针对GNN生成的计算开销与合成数据与真实数据间的领域适应问题提出解决方案。实验表明,图增强版式生成优于现有技术,为文档智能模型训练提供可扩展、灵活的合成数据方案。

原文摘要 · Abstract (English)

The development of robust Document AI models has been constrained by limited access to high-quality, labeled datasets, primarily due to data privacy concerns, scarcity, and the high cost of manual annotation. Traditional methods of synthetic data generation, such as text and image augmentation, have proven effective for increasing data diversity but often fail to capture the complex layout structures present in real world documents. This paper proposes a novel approach to synthetic document layout generation using Graph Neural Networks (GNNs). By representing document elements (e.g., text blocks, images, tables) as nodes in a graph and their spatial relationships as edges, GNNs are trained to generate realistic and diverse document layouts. This method leverages graph-based learning to ensure structural coherence and semantic consistency, addressing the limitations of traditional augmentation techniques. The proposed framework is evaluated on tasks such as document classification, named entity recognition (NER), and information extraction, demonstrating significant performance improvements. Furthermore, we address the computational challenges of GNN based synthetic data generation and propose solutions to mitigate domain adaptation issues between synthetic and real-world datasets. Our experimental results show that graph-augmented document layouts outperform existing augmentation techniques, offering a scalable and flexible solution for training Document AI models.

文档智能图神经网络合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。