arXiv:2412.13782cs.CL2024-12AAAI被引 26

用动态知识图谱精准编辑大模型,提升多跳问答可靠性

Knowledge Editing with Dynamic Knowledge Graphs for Multi-Hop Question Answering

  • 构建动态知识图谱自动处理知识冲突
  • 细粒度检索+实体关系检测,提升答案准确率
  • 适合需要实时知识更新的问答系统使用

多跳问答(MHQA)对大语言模型(LLMs)构成重大挑战,因其需调用大量知识。知识编辑旨在精确修改模型以融入特定知识,同时不损害其他无关知识,为解决该问题提供可能。然而,现有方法难以有效应对知识冲突问题。多数参数保持型编辑方法受限于检索不准,并忽略二次编辑引入的噪声,影响模型推理。本文提出KEDKG,一种基于动态知识图谱的新型知识编辑方法,用于提升MHQA中答案的可靠性。KEDKG包含两个主要步骤:动态知识图谱构建与知识图谱增强生成。首先,自主构建动态知识图谱以存储修订信息并解决潜在知识冲突;其次,采用细粒度检索策略结合实体与关系检测器,提升图谱检索精度,优化模型生成。在多个基准测试上的实验结果表明,KEDKG超越先前最优模型,在动态信息环境下提供更准确、可靠的问答结果。

原文摘要 · Abstract (English)

Multi-hop question answering (MHQA) poses a significant challenge for large language models (LLMs) due to the extensive knowledge demands involved. Knowledge editing, which aims to precisely modify the LLMs to incorporate specific knowledge without negatively impacting other unrelated knowledge, offers a potential solution for addressing MHQA challenges with LLMs. However, current solutions struggle to effectively resolve issues of knowledge conflicts. Most parameter-preserving editing methods are hindered by inaccurate retrieval and overlook secondary editing issues, which can introduce noise into the reasoning process of LLMs. In this paper, we introduce KEDKG, a novel knowledge editing method that leverages a dynamic knowledge graph for MHQA, designed to ensure the reliability of answers. KEDKG involves two primary steps: dynamic knowledge graph construction and knowledge graph augmented generation. Initially, KEDKG autonomously constructs a dynamic knowledge graph to store revised information while resolving potential knowledge conflicts. Subsequently, it employs a fine-grained retrieval strategy coupled with an entity and relation detector to enhance the accuracy of graph retrieval for LLM generation. Experimental results on benchmarks show that KEDKG surpasses previous state-of-the-art models, delivering more accurate and reliable answers in environments with dynamic information.

知识编辑多跳问答动态图谱

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。