arXiv:2508.13250cs.AIcs.CL2025-08KDD被引 20

对比显式与隐式记忆,提升大模型多跳推理能力

Explicit v.s. Implicit Memory: Exploring Multi-hop Complex Reasoning Over Personalized Information

  • 设计多跳个性化推理任务,区分显式与隐式记忆机制
  • 构建数据集与评估框架,验证不同记忆方法在复杂任务中的表现
  • 提出混合记忆方法,兼顾记忆精度与推理效率,适合个性化助手研发

在基于大语言模型的智能体中,记忆是实现个性化的重要能力,用于存储和利用用户信息。尽管已有研究将记忆应用于用户偏好对齐和简单问答,但在真实场景中,复杂任务常需基于大量用户信息进行多跳推理,这对现有记忆机制构成挑战。为此,本文提出多跳个性化推理任务,明确界定该任务并构建数据集与统一评估框架。通过实现多种显式与隐式记忆方法,并开展全面实验,从多个维度评估其性能并分析优劣。此外,探索融合两类范式的混合方法,提出 HybridMem 模型以克服各自局限。实验充分验证了所提方法的有效性。为促进研究,项目已开源至 https://github.com/nuster1128/MPR。

原文摘要 · Abstract (English)

In large language model-based agents, memory serves as a critical capability for achieving personalization by storing and utilizing users' information. Although some previous studies have adopted memory to implement user personalization, they typically focus on preference alignment and simple question-answering. However, in the real world, complex tasks often require multi-hop reasoning on a large amount of user information, which poses significant challenges for current memory approaches. To address this limitation, we propose the multi-hop personalized reasoning task to explore how different memory mechanisms perform in multi-hop reasoning over personalized information. We explicitly define this task and construct a dataset along with a unified evaluation framework. Then, we implement various explicit and implicit memory methods and conduct comprehensive experiments. We evaluate their performance on this task from multiple perspectives and analyze their strengths and weaknesses. Besides, we explore hybrid approaches that combine both paradigms and propose the HybridMem method to address their limitations. We demonstrate the effectiveness of our proposed model through extensive experiments. To benefit the research community, we release this project at https://github.com/nuster1128/MPR.

多跳推理个性化记忆机制LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。