arXiv:2409.19753cs.CL2024-09EMNLP被引 39

用思维链增强知识重写,让大模型更准答复杂知识图谱问题。

CoTKR: Chain-of-Thought Enhanced Knowledge Rewriting for Complex Knowledge Graph Question Answering

  • 分步生成推理过程与知识,避免信息遗漏或冗余。
  • 在多个基准上提升大模型问答准确率,最高增益达12.3%。
  • 利用问答反馈优化重写器,适合复杂知识问答场景。

近期研究探索了使用大语言模型(LLMs)结合检索增强生成(RAG)进行知识图谱问答(KGQA)。现有方法通常将检索到的子图重写为大模型可理解的自然语言格式,但在处理复杂问题时,重写的知识可能包含无关信息、遗漏关键细节,或与问题语义不一致。为此,我们提出一种新型重写方法CoTKR(Chain-of-Thought Enhanced Knowledge Rewriting),通过交错生成推理轨迹与对应知识,缓解单步重写的局限性。此外,为弥合重写器与问答模型间的偏好差距,我们设计训练策略PAQAF(Preference Alignment from Question Answering Feedback),利用问答模型的反馈进一步优化重写器。我们在多个大模型和不同KGQA基准上进行了实验,结果表明,相比以往方法,CoTKR生成的知识表示对问答模型更具帮助,显著提升了大模型在KGQA任务上的表现。

原文摘要 · Abstract (English)

Recent studies have explored the use of Large Language Models (LLMs) with Retrieval Augmented Generation (RAG) for Knowledge Graph Question Answering (KGQA). They typically require rewriting retrieved subgraphs into natural language formats comprehensible to LLMs. However, when tackling complex questions, the knowledge rewritten by existing methods may include irrelevant information, omit crucial details, or fail to align with the question's semantics. To address them, we propose a novel rewriting method CoTKR, Chain-of-Thought Enhanced Knowledge Rewriting, for generating reasoning traces and corresponding knowledge in an interleaved manner, thereby mitigating the limitations of single-step knowledge rewriting. Additionally, to bridge the preference gap between the knowledge rewriter and the question answering (QA) model, we propose a training strategy PAQAF, Preference Alignment from Question Answering Feedback, for leveraging feedback from the QA model to further optimize the knowledge rewriter. We conduct experiments using various LLMs across several KGQA benchmarks. Experimental results demonstrate that, compared with previous knowledge rewriting methods, CoTKR generates the most beneficial knowledge representation for QA models, which significantly improves the performance of LLMs in KGQA.

知识图谱大模型问答系统推理增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。