arXiv:2508.01290cs.CL2025-08被引 4

用部分相关知识唤醒大模型,提升未知实体问答效果

Prompting Large Language Models with Partial Knowledge for Answering Questions with Unseen Entities

  • 通过移除答案路径构造部分相关知识,激发模型内在能力
  • 在两个知识图谱问答数据集上显著优于传统相似度方法
  • 适用于实体链接失败的现实场景,尤其适合知识库不完整时

检索增强生成(RAG)通过补充和替代大语言模型(LLM)中的参数化知识展现出优异性能。检索到的知识可分为三类:明确的答案证据、隐含的答案线索,以及信息不足的上下文,后者又可进一步分为完全无关和部分相关的信息。有效利用部分相关知识仍是RAG系统的关键挑战,尤其是在知识库不完整的情况下。与传统观点相反,我们提出新视角:大语言模型可通过已嵌入的、部分相关的知识被‘唤醒’。为全面研究该现象,我们使用黄金推理路径中的三元组及其变体,通过移除包含答案的路径来构建部分相关知识。我们提供了对大模型唤醒效应的理论分析,并在两个知识图谱问答(KGQA)数据集上进行实验验证。此外,我们提出一项新任务——未见实体知识图谱问答(Unseen Entity KGQA),模拟因知识库不完整导致实体链接失败的真实场景。基于唤醒的方法在实际应用中表现更优,显著优于依赖嵌入相似性、易产生噪声的传统方法。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) shows impressive performance by supplementing and substituting parametric knowledge in Large Language Models (LLMs). Retrieved knowledge can be divided into three types: explicit answer evidence, implicit answer clue, and insufficient answer context which can be further categorized into totally irrelevant and partially relevant information. Effectively utilizing partially relevant knowledge remains a key challenge for RAG systems, especially in incomplete knowledge base retrieval. Contrary to the conventional view, we propose a new perspective: LLMs can be awakened via partially relevant knowledge already embedded in LLMs. To comprehensively investigate this phenomenon, the triplets located in the gold reasoning path and their variants are used to construct partially relevant knowledge by removing the path that contains the answer. We provide theoretical analysis of the awakening effect in LLMs and support our hypothesis with experiments on two Knowledge Graphs (KGs) Question Answering (QA) datasets. Furthermore, we present a new task, Unseen Entity KGQA, simulating real-world challenges where entity linking fails due to KG incompleteness. Our awakening-based approach demonstrates greater efficacy in practical applications, outperforms traditional methods that rely on embedding-based similarity which are prone to returning noisy information.

大模型知识问答部分知识实体识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。