arXiv:2603.15666cs.AI2026-03

将任务经验提炼为精准指令,提升语言代理性能。

Compiled Memory: Not More Information, but More Precise Instructions for Language Agents

  • 通过编译经验生成可执行指令,无需微调或人工干预。
  • 在CUAD上使GPT-4o的F1提升8.7个百分点,精度提升12.5个百分点。
  • 知识与任务绑定,跨模型迁移有效,适合构建通用智能体。

现有语言代理的记忆系统关注记忆管理:如何在上下文预算内检索和分页更多信息。本文提出互补问题——记忆效用:哪些经验值得保留,以及如何改变代理行为。我们提出Atlas,一种记忆内核,将积累的任务经验编译进代理的指令结构中,无需微调、RAG或人工干预。记忆是提炼而非存储;交付方式是指令重写,而非上下文注入。从代理失败与成功中提取的事实经三步晋升门验证后,通过学习子项列表重写代理的系统提示。在CUAD合同分析任务中,优化后的提示使GPT-4o的令牌级F1提升8.7个百分点,精度提升12.5个百分点;在HotpotQA多跳问答任务中,联合F1提升3.16个百分点。消融实验表明该机制的核心特性——训练信号约束:演化后的提示仅学习所授内容,不多不少。将同一提示应用于Claude Sonnet 4.5(由GPT-4o错误编译而成,未修改),联合F1仍提升2.31个百分点,增益集中在Claude基线较优但仍有提升空间的区域,证实编译知识是任务导向而非模型专属。

原文摘要 · Abstract (English)

Existing memory systems for language agents address memory management: how to retrieve and page more information within a context budget. We address a complementary problem -- memory utility: what experience is worth keeping, and how it should change agent behavior. We present Atlas, a memory kernel that compiles accumulated task experience into an agent's instruction structure -- without fine-tuning, RAG, or human intervention. Memory is distillation, not storage; delivery is instruction rewriting, not context injection. Facts extracted from agent failures and successes are verified through a three-step promotion gate and delivered by rewriting the agent's system prompt with learned sub-bullets. On CUAD contract analysis, the evolved prompt improves GPT-4o token-level F1 by $+8.7$pp and precision by $+12.5$pp. On HotpotQA multi-hop QA, joint F1 improves $+3.16$pp. An ablation isolates the mechanism's defining property -- the training signal constraint: the evolved prompt learns exactly what it is taught, and nothing more. Applied to Claude Sonnet~4.5 using the same evolved prompt -- compiled from GPT-4o errors, unchanged -- joint F1 improves $+2.31$pp, with gains concentrating where Claude's stronger baseline leaves the most room -- confirming that the compiled knowledge is task-shaped, not model-shaped.

语言代理记忆编译指令优化零样本迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。