用知识图谱生成推理路径,让大模型更会用已知知识答题。
KALE: Enhancing Knowledge Manipulation in Large Language Models via Knowledge-aware Learning
- 从知识图谱提取多跳推理路径,生成高质量答案理由。
- 通过最小化有无理由时的预测差异,提升模型知识运用能力。
- 在8个基准上平均提效4.18%,最高提升11.72%,适合想增强推理的开发者。
尽管大规模语言模型(LLMs)在海量知识语料上预训练表现优异,但其知识操控能力——即有效召回、推理和迁移相关知识的能力——仍面临挑战。现有方法主要依赖标注数据上的监督微调(SFT),但发现模型虽掌握相关知识却无法正确使用。为此,本文提出KALE(知识感知学习)——一种后训练框架,利用知识图谱(KGs)生成高质量推理路径以增强知识操控能力。具体而言,KALE首先采用知识诱导(KI)数据合成方法,高效提取知识图谱中的多跳推理路径,生成问题-答案对的高质量理由;随后采用知识感知(KA)微调范式,通过最小化有无理由时预测结果的KL散度,使模型内化基于理由的推理过程。在六个不同大型语言模型上的八个主流基准测试中,实验表明KALE显著有效,准确率最高提升11.72%,平均提升4.18%。
原文摘要 · Abstract (English)
Despite the impressive performance of large language models (LLMs) pretrained on vast knowledge corpora, advancing their knowledge manipulation-the ability to effectively recall, reason, and transfer relevant knowledge-remains challenging. Existing methods mainly leverage Supervised Fine-Tuning (SFT) on labeled datasets to enhance LLMs' knowledge manipulation ability. However, we observe that SFT models still exhibit the known&incorrect phenomenon, where they explicitly possess relevant knowledge for a given question but fail to leverage it for correct answers. To address this challenge, we propose KALE (Knowledge-Aware LEarning)-a post-training framework that leverages knowledge graphs (KGs) to generate high-quality rationales and enhance LLMs' knowledge manipulation ability. Specifically, KALE first introduces a Knowledge-Induced (KI) data synthesis method that efficiently extracts multi-hop reasoning paths from KGs to generate high-quality rationales for question-answer pairs. Then, KALE employs a Knowledge-Aware (KA) fine-tuning paradigm that enhances knowledge manipulation by internalizing rationale-guided reasoning through minimizing the KL divergence between predictions with and without rationales. Extensive experiments on eight popular benchmarks across six different LLMs demonstrate the effectiveness of KALE, achieving accuracy improvements of up to 11.72% and an average of 4.18%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。