arXiv:2603.10600cs.AIcs.DB2026-03被引 13

让智能体从执行轨迹中自动提炼经验,提升未来表现。

Trajectory-Informed Memory Generation for Self-Improving Agent Systems

  • 分析智能体推理路径,识别成败关键决策
  • 生成策略、恢复和优化三类可操作建议
  • 按任务上下文精准召回经验,适合复杂任务优化

基于大模型的智能体面临持续挑战:如何从执行经验中学习以改进未来表现。尽管能完成多项任务,但常重复低效模式、无法从相似错误中恢复,也错失复用成功策略的机会。本文提出一种新框架,自动从智能体执行轨迹中提取可行动的学习成果,并通过上下文记忆检索提升后续性能。该框架包含四个组件:(1) 轨迹智能提取器,进行推理模式的语义分析;(2) 决策归因分析器,识别导致失败、恢复或低效的关键决策与步骤;(3) 上下文学习生成器,生成三类指导——来自成功模式的策略提示、来自失败处理的恢复提示、以及来自低效但成功的执行的优化提示;(4) 自适应记忆检索系统,基于多维相似性将相关学习注入智能体提示。相比存储通用对话事实的传统记忆系统,本框架理解执行模式,提取带溯源的结构化学习,并在特定任务上下文中精准推荐指导。在AppWorld基准上的评估显示一致改进,持留任务上场景目标完成率最高提升14.3个百分点,复杂任务提升达28.5~个百分点(相对增长149%)。

原文摘要 · Abstract (English)

LLM-powered agents face a persistent challenge: learning from their execution experiences to improve future performance. While agents can successfully complete many tasks, they often repeat inefficient patterns, fail to recover from similar errors, and miss opportunities to apply successful strategies from past executions. We present a novel framework for automatically extracting actionable learnings from agent execution trajectories and utilizing them to improve future performance through contextual memory retrieval. Our approach comprises four components: (1) a Trajectory Intelligence Extractor that performs semantic analysis of agent reasoning patterns, (2) a Decision Attribution Analyzer that identifies which decisions and reasoning steps led to failures, recoveries, or inefficiencies, (3) a Contextual Learning Generator that produces three types of guidance -- strategy tips from successful patterns, recovery tips from failure handling, and optimization tips from inefficient but successful executions, and (4) an Adaptive Memory Retrieval System that injects relevant learnings into agent prompts based on multi-dimensional similarity. Unlike existing memory systems that store generic conversational facts, our framework understands execution patterns, extracts structured learnings with provenance, and retrieves guidance tailored to specific task contexts. Evaluation on the AppWorld benchmark demonstrates consistent improvements, with up to 14.3 percentage point gains in scenario goal completion on held-out tasks and particularly strong benefits on complex tasks (28.5~pp scenario goal improvement, a 149\% relative increase).

智能体自我改进记忆机制任务优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。