AutoMem自动搜索适配任务的内存架构,性能优于人工设计
AutoMem: A Text-Gradient Recursive Self-Improvement Framework for Automated Memory Architectures Search

- 通过历史经验与失败反馈递归优化内存模块组合
- 在多个基准上平均提升准确率2.8点,减少14.3%令牌开销
- 适合需要高效自适应记忆的智能体开发人员
长时记忆在大模型智能体中日益关键,但记忆设计仍是高度耦合的架构难题:编码内容、存储方式、检索策略和管理机制在不同任务与模型间差异显著。我们构建了一个包含5种编码器、5种存储器、6种检索器和4种管理器的离散搜索空间,发现单一记忆架构无法通用,不同任务偏好不同模块组合,导致显著性能差距。为此,我们提出 extsc{AutoMem},一种基于文本梯度的递归自改进框架,用于任务自适应记忆架构搜索。其包含两个组件:经验引导的架构搜索,从历史轨迹与反思中生成候选架构;故障引导的模块诊断,定位记忆相关失败并转化为针对性文本反馈。在GAIA、WebWalkerQA和xBench-DeepSearch三个基准上,针对两种大模型骨干,在六组设置下, extsc{AutoMem}持续发现优于最强人工设计基线的记忆架构,平均准确率提升2.8点。进一步分析显示,该方法实现良好精度-效率权衡,在Qwen3.5-122B-A10B上相比最强准确率基线降低14.3%令牌消耗,且仅用少数引导迭代即找到优于大规模随机搜索的更强架构。
原文摘要 · Abstract (English)
Long-term memory is increasingly central to LLM agents, yet memory design remains a highly coupled architecture problem: what to encode, how to store it, how to retrieve it, and how to manage it can vary substantially across tasks and backbone models. We construct a discrete search space with 5 encoders, 5 stores, 6 retrievers, and 4 managers, and show that no single memory architecture consistently dominates: different tasks favor different module combinations, leading to substantial performance gaps. Motivated by this, we propose \textsc{AutoMem}, a text-gradient recursive self-improvement framework for task-adaptive memory architecture search. \textsc{AutoMem} optimizes over the factored space through two components: Experience-Guided Architecture Search, which proposes candidate architectures from historical search trajectories and accumulated reflections, and Failure-Guided Module Diagnosis, which localizes memory-related failures to specific modules and converts them into targeted textual feedback. Experiments on GAIA, WebWalkerQA, and xBench-DeepSearch across two LLM backbones show that \textsc{AutoMem} consistently discovers task-adaptive memory architectures that outperform the strongest human-designed memory baselines, improving accuracy by $2.8$ points on average across six benchmark-backbone settings. Further analysis shows that \textsc{AutoMem} achieves a favorable accuracy-efficiency trade-off, reducing token cost by $14.3\%$ over the strongest accuracy baselines under Qwen3.5-122B-A10B, while also finding stronger architectures than substantially larger random searches within only a few guided iterations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。