arXiv:2412.17092cs.CLcs.AI2024-12AAAI被引 8

SAIL通过细粒度文本与版式相似性,提升大模型在文档信息抽取中的精准度。

SAIL: Sample-Centric In-Context Learning for Document Information Extraction

  • 基于实体级文本和版式相似性,增强大模型对文档结构的理解。
  • 在FUNSD、CORD、SROIE上超越无训练基线,逼近全量训练效果。
  • 适用于需要快速适配新文档类型的场景,尤其适合资源受限部署。

文档信息抽取(DIE)旨在从视觉丰富文档(VRDs)中提取结构化信息。以往的全量训练方法虽表现强劲,但在未见数据上泛化能力有限。相比之下,免训练方法利用大语言模型(LLMs)仅用少量示例即可应对下游任务。然而,现有免训练方法在DIE中面临两大挑战:(1)理解VRDs中布局与文本元素间的复杂关系;(2)为预训练模型提供准确引导。为此,我们提出样本中心的上下文学习(SAIL)。SAIL引入细粒度实体级文本相似性,促进LLM进行深入文本分析,并融合布局相似性以增强对文档版式的分析。此外,SAIL设计统一的上下文学习提示模板,针对不同样本生成定制化提示,为预训练模型提供精准指导。在FUNSD、CORD和SROIE基准上的大量实验表明,该方法在多种基础模型(如LLMs)下均优于免训练基线,甚至接近全量训练方法,展现出优异的性能与泛化能力。

原文摘要 · Abstract (English)

Document Information Extraction (DIE) aims to extract structured information from Visually Rich Documents (VRDs). Previous full-training approaches have demonstrated strong performance but may struggle with generalization to unseen data. In contrast, training-free methods leverage powerful pre-trained models like Large Language Models (LLMs) to address various downstream tasks with only a few examples. Nonetheless, training-free methods for DIE encounter two primary challenges: (1) understanding the complex relationship between layout and textual elements in VRDs, and (2) providing accurate guidance to pre-trained models. To address these challenges, we propose Sample-centric In-context Learning (SAIL) for DIE. SAIL introduces a fine-grained entity-level textual similarity to facilitate in-depth text analysis by LLMs and incorporates layout similarity to enhance the analysis of layouts in VRDs. Additionally, SAIL formulates a unified In-Context Learning (ICL) prompt template for various sample-centric examples, enabling tailored prompts that deliver precise guidance to pre-trained models for each sample. Extensive experiments on FUNSD, CORD, and SROIE benchmarks with various base models (e.g., LLMs) indicate that our method outperforms training-free baselines, even closer to the full-training methods. The results show the superiority and generalization of our method.

文档抽取上下文学习大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。