arXiv:2411.02864cs.CLcs.AI2024-11

用图思维推理提升少样本文档关系抽取效果

Graph-DPEP: Decomposed Plug and Ensemble Play for Few-Shot Document Relation Extraction with Graph-of-Thoughts Reasoning

  • 将关系抽取结果表示为三元组图结构,分步生成降低类型混淆
  • 验证器识别遗漏实体对,集成策略补全缺失关系
  • 适合需要高精度少样本关系抽取的研究者使用

预训练的大规模语言模型在多项自然语言处理任务中展现出强大的少样本学习能力。将NLP任务重构为文本到文本生成任务是常见做法,使生成式大模型可通过提示完成任务。然而,文档级关系抽取(DocRE)因输出格式结构化,难以直接转化为自然语言,给生成式大模型带来挑战。少样本数据和提示信息有限进一步加剧了实体间关系抽取的难度。本文提出Graph-DPEP框架,将结构化输出表示为图形式三元组,并利用生成式大模型进行关系抽取。该框架基于自然语言中三元组解释的推理过程:首先采用“分解-插接”方法,通过类型空间分解减轻模型区分所有关系类型的负担;其次引入验证器校准生成结果并识别遗漏的查询实体对;最后设计“集成-演绎”策略,基于缺失实体对相关子图中的推理思想,重新对完整类型列表进行生成,解决遗漏问题。在多个公开基准上的实验表明,该框架在性能上优于现有提示技术与替代语言模型。

原文摘要 · Abstract (English)

Large language models (LLMs) pre-trained on massive corpora have demonstrated impressive few-shot learning capability on many NLP tasks. Recasting an NLP task into a text-to-text generation task is a common practice so that generative LLMs can be prompted to resolve it. However, performing document-level relation extraction (DocRE) tasks with generative LLM models is still challenging due to the structured output format of DocRE, which complicates the conversion to plain text. Limited information available in few-shot samples and prompt instructions induce further difficulties and challenges in relation extraction for mentioned entities in a document. In this paper, we represent the structured output as a graph-style triplet rather than natural language expressions and leverage generative LLMs for the DocRE task. Our approach, the Graph-DPEP framework is grounded in the reasoning behind triplet explanation thoughts presented in natural language. In this framework, we first introduce a ``decomposed-plug" method for performing the generation from LLMs over prompts with type-space decomposition to alleviate the burden of distinguishing all relation types. Second, we employ a verifier for calibrating the generation and identifying overlooked query entity pairs. Third, we develop "ensemble-play", reapplying generation on the entire type list by leveraging the reasoning thoughts embedded in a sub-graph associated with the missing query pair to address the missingness issue. Through extensive comparisons with existing prompt techniques and alternative Language Models (LLMs), our framework demonstrates superior performance on publicly available benchmarks in experiments.

关系抽取少样本学习图思维大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。