arXiv:2511.12997cs.AIcs.CL2025-11被引 11

让网页智能体学会跨会话记忆,持续自我进化。

WebCoach: Self-Evolving Web Agents with Cross-Session Memory Guidance

  • 用摘要压缩与记忆存储技术,实现长期经验留存。
  • 38B模型任务成功率从47%提升至61%,步数不增。
  • 无需重训练,小模型也能逼近GPT-4o表现。

多模态大模型驱动的智能体在网页导航中展现出强大能力,可完成跨领域的复杂浏览任务。然而,现有智能体普遍存在重复错误,且缺乏跨会话学习能力,限制了其长期鲁棒性和样本效率。我们提出WebCoach——一个与模型无关的自演化框架,赋予网页导航智能体持久的跨会话记忆,支持长期规划、反思与持续学习而无需重训练。WebCoach包含三个核心组件:(1) WebCondenser,将原始导航日志标准化为简洁摘要;(2) 外部记忆库,以情景记忆形式组织完整轨迹;(3) 教练(Coach),基于相似性与时效性检索相关经验,并通过运行时钩子注入任务特定建议。该设计使智能体突破原生上下文窗口限制,显著提升复杂任务中的鲁棒性。此外,WebCoach通过持续从新轨迹中提炼情景记忆实现自演化,使智能体在无重训练前提下逐步改进。在WebVoyager基准上的评估显示,WebCoach在三种不同大模型后端上均稳定提升性能:使用38B模型时,任务成功率由47%提升至61%,平均步数维持或减少。值得注意的是,搭配WebCoach的小型基模型表现已可媲美使用GPT-4o的同款智能体。

原文摘要 · Abstract (English)

Multimodal LLM-powered agents have recently demonstrated impressive capabilities in web navigation, enabling agents to complete complex browsing tasks across diverse domains. However, current agents struggle with repetitive errors and lack the ability to learn from past experiences across sessions, limiting their long-term robustness and sample efficiency. We introduce WebCoach, a model-agnostic self-evolving framework that equips web browsing agents with persistent cross-session memory, enabling improved long-term planning, reflection, and continual learning without retraining. WebCoach consists of three key components: (1) a WebCondenser, which standardizes raw navigation logs into concise summaries; (2) an External Memory Store, which organizes complete trajectories as episodic experiences; and (3) a Coach, which retrieves relevant experiences based on similarity and recency, and decides whether to inject task-specific advice into the agent via runtime hooks. This design empowers web agents to access long-term memory beyond their native context window, improving robustness in complex browsing tasks. Moreover, WebCoach achieves self-evolution by continuously curating episodic memory from new navigation trajectories, enabling agents to improve over time without retraining. Evaluations on the WebVoyager benchmark demonstrate that WebCoach consistently improves the performance of browser-use agents across three different LLM backbones. With a 38B model, it increases task success rates from 47% to 61% while reducing or maintaining the average number of steps. Notably, smaller base models with WebCoach achieve performance comparable to the same web agent using GPT-4o.

智能体自演化记忆机制网页导航

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。