让大模型记忆更可靠,通过持久化验证信号防止错误信息累积。
MemGuard: Persisting Verifier Signals for LLM-Agent Memory Governance

- 将验证结果作为持久元数据,伴随记忆全程使用
- 在多个基准上平均提升成功率7.9点,减少平均步骤数
- 适合需要长期可靠记忆的自动化任务系统
大模型智能体正从单次提示转向长流程任务,可复用的记忆成为终端操作、软件工程和网页任务的核心能力。然而,真实场景中存在两种失效模式:一是不可靠的记录准入——错误轨迹、偶然成功和误导性观察因看似相关而被存入,后续导致决策偏差;二是记忆漂移——长期运行积累重复、过时和冲突的记录,仅靠检索无法修复。MemGuard的关键创新是将验证输出视为持久生命周期元数据,而非一次性过滤工具。它将多准则评分转化为奖励、置信度、标签和不确定性描述符,附着于每个候选记忆项,在激活前及检索、冲突消解、摘要和归档阶段持续使用。我们在Terminal-Bench 2.0、SWE-Bench Verified、WebArena和Mind2Web上评估了四种骨干网络,对比四种记忆基线与仅使用验证器的对照组,在相同运行预算下,五次种子实验平均结果显示,MemGuard在全部16个组合设置中均取得最优成功指标和最低平均步数。相较于最强基线ReasoningBank,最大提升达7.9个百分点(WebArena)、5.6步成功率点(Mind2Web),终端与软件工程基准提升2.4–3.5点。代码已开源:https://github.com/whyyyyy123/MemGuard。
原文摘要 · Abstract (English)
LLM agents are moving from single-prompt use to long task streams in which reusable memory becomes a core capability for terminal, software-engineering, and web tasks. Such memory is useful only when stored experience remains reliable across hundreds of interactions, but two failure modes break that assumption in practice. The first is unreliable admission: failed trajectories,accidental successes, and misleading observations enter memory because they appear relevant, then mislead later decisions. The second is memory drift: long-running banks accumulate duplicate, stale, and conflicting records that retrieval alone cannot repair. MemGuard's key distinction is to treat verifier output not as a one-shot filter, but as persistent lifecycle metadata. It converts multi-criteria score-token verification into reward, confidence, label, and uncertainty descriptors that are attached to every candidate before activation and reused during retrieval, conflict resolution, summarization, and archival. We evaluate MemGuard on Terminal-Bench 2.0, SWE-Bench Verified, WebArena, and Mind2Web across four backbones, comparing against four memory baselines plus a verifier-only control under matched runtime budgets. Averaged over five seeds, MemGuard achieves the best success metric and lowest average steps in all 16 backbone-benchmark settings, improving over ReasoningBank, the strongest prior baseline among the memory methods we evaluate, with a largest gain of 7.9 success-rate points on WebArena, 5.6 step-success-rate points on Mind2Web, and 2.4-3.5 points on terminal and software-engineering benchmarks. Code is available at https://github.com/whyyyyy123/MemGuard.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。