用结构化规划+时间检索增强大模型,解决时序知识图谱问答中的幻觉和不准问题。
Plan of Knowledge: Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answering
- 将复杂时序问题拆解为步骤化子目标,引导模型分步推理。
- 构建对比式时序知识库,精准召回时空匹配的事实数据。
- 在4个基准数据集上提升准确率超56%,适合需要高可信推理的场景。
时序知识图谱问答(TKGQA)旨在通过时序知识图谱(TKGs)回答涉及时间约束的问题。以往方法依赖预训练的时序嵌入或图神经网络注入时序信息,但难以充分理解时间条件的复杂语义。近期大语言模型(LLMs)凭借强大的语义理解与推理泛化能力取得显著进展,但其时序推理能力仍有限,常出现幻觉且缺乏知识。为此,我们提出计划知识框架(PoK),包含对比式时序检索器。具体地,计划知识模块将复杂时序问题分解为预定义工具下的子目标序列,作为推理探索的中间指引;同时,构建时序知识库(TKS),采用对比检索框架,使模型能从TKGs中选择性地检索语义与时间对齐的事实。结合结构化规划与时序知识检索,PoK显著提升时序推理的可解释性与事实一致性。在四个基准TKGQA数据集上的实验表明,PoK显著提升LLMs的检索精度与推理准确率,最高超越现有最优方法56.0%。
原文摘要 · Abstract (English)
Temporal Knowledge Graph Question Answering (TKGQA) aims to answer time-sensitive questions by leveraging factual information from Temporal Knowledge Graphs (TKGs). While previous studies have employed pre-trained TKG embeddings or graph neural networks to inject temporal knowledge, they fail to fully understand the complex semantic information of time constraints. Recently, Large Language Models (LLMs) have shown remarkable progress, benefiting from their strong semantic understanding and reasoning generalization capabilities. However, their temporal reasoning ability remains limited. LLMs frequently suffer from hallucination and a lack of knowledge. To address these limitations, we propose the Plan of Knowledge framework with a contrastive temporal retriever, which is named PoK. Specifically, the proposed Plan of Knowledge module decomposes a complex temporal question into a sequence of sub-objectives from the pre-defined tools, serving as intermediate guidance for reasoning exploration. In parallel, we construct a Temporal Knowledge Store (TKS) with a contrastive retrieval framework, enabling the model to selectively retrieve semantically and temporally aligned facts from TKGs. By combining structured planning with temporal knowledge retrieval, PoK effectively enhances the interpretability and factual consistency of temporal reasoning. Extensive experiments on four benchmark TKGQA datasets demonstrate that PoK significantly improves the retrieval precision and reasoning accuracy of LLMs, surpassing the performance of the state-of-the-art TKGQA methods by 56.0% at most.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。