arXiv:2506.17001cs.CLcs.IR2025-06被引 1

用知识图谱增强LLM的个人记忆,支持动态更新与多模式检索。

PersonalAI: A Systematic Comparison of Knowledge Graph Storage and Retrieval Approaches for Personalized LLM agents

  • 基于LLM自动生成并维护知识图谱,融合普通边与两种超边。
  • 在TriviaQA等基准上表现优于传统RAG,特定任务下性能提升12%。
  • 适合需要长期记忆和时序推理的个性化AI助手开发。

通过有效融合用户交互历史来个性化语言模型,仍是构建自适应AI系统的核心挑战。尽管大语言模型(LLMs)结合检索增强生成(RAG)提升了事实准确性,但往往缺乏结构化记忆且难以在复杂、长期交互中扩展。为此,我们提出一种基于知识图谱的灵活外部记忆框架,该图谱由LLM自动构建与更新。在AriGraph架构基础上,引入新型混合图结构,支持标准边及两类超边,实现丰富的语义与时间表征。框架还支持多种检索机制,包括A*、WaterCircles遍历、束搜索及混合方法,适配不同数据集与模型能力。我们在TriviaQA、HotpotQA、DiaASQ基准上评估系统,发现不同记忆与检索配置在任务间表现最优。此外,我们扩展了DiaASQ基准,加入时间标注与内部矛盾陈述,验证了系统在处理时间依赖与上下文推理方面的鲁棒性与有效性。

原文摘要 · Abstract (English)

Personalizing language models by effectively incorporating user interaction history remains a central challenge in the development of adaptive AI systems. While large language models (LLMs), combined with Retrieval-Augmented Generation (RAG), have improved factual accuracy, they often lack structured memory and fail to scale in complex, long-term interactions. To address this, we propose a flexible external memory framework based on a knowledge graph that is constructed and updated automatically by the LLM. Building upon the AriGraph architecture, we introduce a novel hybrid graph design that supports both standard edges and two types of hyper-edges, enabling rich and dynamic semantic and temporal representations. Our framework also supports diverse retrieval mechanisms, including A*, WaterCircles traversal, beam search, and hybrid methods, making it adaptable to different datasets and LLM capacities. We evaluate our system on TriviaQA, HotpotQA, DiaASQ benchmarks and demonstrate that different memory and retrieval configurations yield optimal performance depending on the task. Additionally, we extend the DiaASQ benchmark with temporal annotations and internally contradictory statements, showing that our system remains robust and effective in managing temporal dependencies and context-aware reasoning

知识图谱个性化LLM记忆增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。