用动态知识图谱提升大模型的时间推理能力,让小模型也能追上大模型表现。
Temporal Reasoning with Large Language Models Augmented by Evolving Knowledge Graphs
- 设计多跳推理算法,结合全局局部实体定位与时间锚定评分。
- 80亿参数模型在动态问答中媲美6710亿参数模型,差距显著缩小。
- 适合需要实时知识更新的智能问答、时序分析等场景使用。
大语言模型在理解任务上表现出色,但在处理随时间演化的知识时存在困难。现有方法虽尝试用知识图谱(KG)增强模型,但多基于静态快照,忽略真实数据中的时序动态与事实矛盾。为此,我们提出EvoReasoner,一种面向时间演化的多跳推理算法,实现全局-局部实体对齐、多路径分解与时间锚定评分。为保障知识图谱的准确与时效性,我们引入EvoKG,一个噪声容忍的图谱演化模块,通过置信度驱动的矛盾消解与时间趋势追踪,从非结构化文档中增量更新知识图谱。我们在时间问答基准和新提出的端到端动态更新设置下评估该方法,结果表明其性能优于提示法与知识图谱增强基线,在动态问答中有效缩小了小模型与大模型的差距。值得注意的是,一个80亿参数的模型经本方法处理后,达到了6710亿参数模型在七个月后提示的效果。这些结果凸显了融合时间推理与图谱演化的必要性,以实现鲁棒且持续更新的大模型表现。代码已开源:github.com/junhongmit/TREK。
原文摘要 · Abstract (English)
Large language models (LLMs) excel at many language understanding tasks but struggle to reason over knowledge that evolves. To address this, recent work has explored augmenting LLMs with knowledge graphs (KGs) to provide structured, up-to-date information. However, many existing approaches assume a static snapshot of the KG and overlook the temporal dynamics and factual inconsistencies inherent in real-world data. To address the challenge of reasoning over temporally shifting knowledge, we propose EvoReasoner, a temporal-aware multi-hop reasoning algorithm that performs global-local entity grounding, multi-route decomposition, and temporally grounded scoring. To ensure that the underlying KG remains accurate and up-to-date, we introduce EvoKG, a noise-tolerant KG evolution module that incrementally updates the KG from unstructured documents through confidence-based contradiction resolution and temporal trend tracking. We evaluate our approach on temporal QA benchmarks and a novel end-to-end setting where the KG is dynamically updated from raw documents. Our method outperforms both prompting-based and KG-enhanced baselines, effectively narrowing the gap between small and large LLMs on dynamic question answering. Notably, an 8B-parameter model using our approach matches the performance of a 671B model prompted seven months later. These results highlight the importance of combining temporal reasoning with KG evolution for robust and up-to-date LLM performance. Our code is publicly available at github.com/junhongmit/TREK.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。