让智能体在没任务时先自练,用可控的模拟练习构建高效记忆。
PREPING: Building Agent Memory without Tasks

- 用提议者控制生成练习内容,避免无效重复。
- 在多个环境上表现媲美有任务经验的模型,部署成本降低2.23倍。
- 适合想减少真实交互、快速启动智能体的开发者。
智能体通常依赖精心挑选的示范数据或上线后的互动来构建记忆,但面对新环境时仍存在冷启动问题。本文研究任务前记忆构建:智能体能否在未接触目标任务前,仅通过自生成的合成练习建立程序性记忆?单纯合成交互不足,因缺乏对练习内容和存储选择的控制,导致任务冗余、不可行且记忆迅速退化。为此,提出Preping框架,核心为提议者记忆——一种结构化控制状态。提议者据此生成合成任务,求解器执行,验证器筛选合格轨迹存入记忆,并提供反馈优化后续提议。在AppWorld、BFCL v3和MCP-Universe上的实验表明,Preping显著优于无记忆基线,在性能上接近基于离线或在线经验的强基准方法,且在AppWorld上部署成本仅为在线记忆构建的2.99倍,在BFCL v3上为2.23倍。分析显示,其优势主要源于提议端对可行性、冗余性和覆盖范围的控制,以及选择性记忆更新机制。
原文摘要 · Abstract (English)
Agent memory is typically constructed either offline from curated demonstrations or online from post-deployment interactions. However, regardless of how it is built, an agent faces a cold-start gap when first introduced to a new environment without any task-specific experience available. In this paper, we study pre-task memory construction: whether an agent can build procedural memory before observing any target-environment tasks, using only self-generated synthetic practice. Yet, synthetic interaction alone is insufficient, as without controlling what to practice and what to store, synthetic tasks become redundant, infeasible, and ultimately uninformative, and memory further degrades quickly due to unfiltered trajectories. To overcome this, we present Preping, a proposer-guided memory construction framework. At its core is proposer memory, a structured control state that shapes future practice. A Proposer generates synthetic tasks conditioned on this state, a Solver executes them, and a Validator determines which trajectories are eligible for memory insertion while also providing feedback to guide future proposals. Experiments on AppWorld, BFCL v3, and MCP-Universe show that Preping substantially improves over a no-memory baseline and achieves performance competitive with strong playbook-based methods built from offline or online experience, with deployment cost $2.99\times$ lower on AppWorld and $2.23\times$ lower on BFCL v3 than online memory construction. Further analyses reveal that the main benefit does not come from synthetic volume alone, but from proposer-side control over feasibility, redundancy, and coverage, combined with selective memory updates.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。