让智能体按任务动态重组记忆,提升长序列决策能力
MemPrism: Task-Conditioned Relational Memory Views for Long-Horizon Agents

- 根据任务需求动态构建关系记忆视图,分离长期存储与临时使用
- 在长轨迹任务中性能显著提升,同时减少记忆消耗
- 记忆结构可跨视觉语言模型复用,适合作为通用记忆接口
长时序智能体依赖记忆复用经验,但现有记忆系统常假设证据可通过固定表征直接使用,导致表征不匹配——相关信息存在却未按当前决策组织。为此,我们提出 MemPrism,一种任务条件下的关系记忆框架,将持久经验存储与决策时刻工作记忆分离。MemPrism 将交互记录为事件流,并根据当前任务上下文动态构建关系视图。轻量级视图策略选择关系结构、证据范围、结果条件和粒度,再由确定性组合器与渲染变换将历史事实转化为冻结任务策略可用的临时视觉工作记忆视图。在长时序具身与网页代理基准上的实验表明,MemPrism 在轨迹变长时持续提升任务性能,同时降低记忆标记消耗。此外,学习到的视图策略无需额外适配即可在不同 VLM 间迁移,证明任务条件关系视图作为智能体通用记忆接口的有效性。
原文摘要 · Abstract (English)
Long-horizon agents rely on memory to reuse experiences, yet existing memory systems often assume that evidence can be directly consumed through a fixed representation. This leads to representation mismatch, where relevant information is available but not organized for the current decision. To this end, we propose MemPrism, a task-conditioned relational memory framework that separates persistent experience storage from decision-time working memory. MemPrism records interactions as the event stream and dynamically constructs relational views according to the current task context. A lightweight view policy selects the relation structure, evidence range, outcome condition, and granularity, while a deterministic composer and render transform historical facts into a temporary optical working-memory view for a frozen task policy. Experiments on long-horizon embodied and web-agent benchmarks show that MemPrism consistently improves the task performance, especially as trajectories become longer, while reducing memory token consumption. Furthermore, the learned view policy transfers across different VLMs without additional adaptation, demonstrating the effectiveness of task-conditioned relational views as a general memory interface for agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。