让智能体学会记忆、回忆与反思,显著提升长对话理解能力。
Hindsight is 20/20: Building Agent Memory that Retains, Recalls, and Reflects
- 将记忆分为事实、经验、摘要和信念四类网络,支持结构化推理
- 在长对话任务上准确率从39%提升至83.6%,超越GPT-4o
- 适合需要持续学习与可解释推理的多轮交互系统
智能体记忆被视为大型语言模型应用成长的关键维度,使智能体能积累经验、跨会话适应,并超越单次问答。当前记忆系统将记忆视为外部层,从对话中提取关键片段,存入向量或图数据库,并将前k项检索结果注入无状态模型的提示中。尽管提升了个性化与上下文延续性,但这类系统仍模糊证据与推理边界,难以长期组织信息,且对需解释推理的智能体支持有限。本文提出Hindsight,一种将记忆作为结构化第一性原理的推理基础的架构,将其划分为世界事实、智能体经验、合成实体摘要和演化信念四类逻辑网络。该框架支持保留、回忆、反思三类核心操作,控制信息的添加、访问与更新。在此抽象下,时序化、实体感知的记忆层将对话流逐步转化为可查询的结构化记忆库,而反思层则基于此库生成答案并以可追溯方式更新信息。在LongMemEval与LoCoMo等长时对话记忆基准上,使用20B开源模型的Hindsight将整体准确率从39%提升至83.6%,超越同模型全上下文基线,优于GPT-4o;进一步扩展模型规模后,准确率达91.4%(LongMemEval)与89.61%(LoCoMo),显著优于现有最强开源系统(75.78%),在多会话与开放域问题上持续领先。
原文摘要 · Abstract (English)
Agent memory has been touted as a dimension of growth for LLM-based applications, enabling agents that can accumulate experience, adapt across sessions, and move beyond single-shot question answering. The current generation of agent memory systems treats memory as an external layer that extracts salient snippets from conversations, stores them in vector or graph-based stores, and retrieves top-k items into the prompt of an otherwise stateless model. While these systems improve personalization and context carry-over, they still blur the line between evidence and inference, struggle to organize information over long horizons, and offer limited support for agents that must explain their reasoning. We present Hindsight, a memory architecture that treats agent memory as a structured, first-class substrate for reasoning by organizing it into four logical networks that distinguish world facts, agent experiences, synthesized entity summaries, and evolving beliefs. This framework supports three core operations -- retain, recall, and reflect -- that govern how information is added, accessed, and updated. Under this abstraction, a temporal, entity aware memory layer incrementally turns conversational streams into a structured, queryable memory bank, while a reflection layer reasons over this bank to produce answers and to update information in a traceable way. On key long-horizon conversational memory benchmarks like LongMemEval and LoCoMo, Hindsight with an open-source 20B model lifts overall accuracy from 39% to 83.6% over a full-context baseline with the same backbone and outperforms full context GPT-4o. Scaling the backbone further pushes Hindsight to 91.4% on LongMemEval and up to 89.61% on LoCoMo (vs. 75.78% for the strongest prior open system), consistently outperforming existing memory architectures on multi-session and open-domain questions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。