让网页智能体根据当前页面状态动态调用技能,提升自动化成功率。
Online Skill Learning for Web Agents via State-Grounded Dynamic Retrieval

- 按执行状态提取可复用子流程,支持中途灵活调用。
- 在五类任务上用GPT-4.1达37.5%成功率,较基线提升10.6%。
- 适合需要实时适应网页变化的复杂自动化场景。
语言智能体越来越多依赖可复用技能以提升多步骤网页自动化性能。现有在线技能学习方法主要在任务层面静态复用:根据初始指令检索一组固定技能并全程使用。然而,这种静态策略与网页执行实际不符,因合适操作不仅取决于任务目标,还依赖当前网页状态,而状态变化常导致初始技能失效。为此,我们提出状态引导的动态检索(SGDR),实现分步技能复用。SGDR包含三部分:滑动窗口提取机制将已完成轨迹转为可在中间状态调用的子程序;双模态文本-代码表示连接技能检索与可执行动作;状态引导的动态检索机制同时匹配任务目标与当前网页状态。在WebArena五个领域上的实验表明,SGDR持续优于强基线,采用GPT-4.1时平均成功率达37.5%,采用Qwen3-4B时为24.3%,分别相较最强基线提升10.6%和10.0%。代码已开源。
原文摘要 · Abstract (English)
Language agents increasingly rely on reusable skills to improve multi-step web automation across related tasks. A growing line of work studies online skill learning, where agents continually induce skills from previous task trajectories and reuse them in future tasks on the fly. However, existing methods mainly reuse skills at the task-level: a fixed set of skills is retrieved based on the initial task instruction and then held fixed throughout execution. This static strategy is misaligned with web execution, where the appropriate next action depends not only on the task goal but also on the current webpage state, which often transitions into situations that the initial skills fail to cover. To address this gap, we propose State-Grounded Dynamic Retrieval (SGDR), an online skill learning method that enables stepwise skill reuse for web agents. SGDR consists of three components: a sliding-window extraction process that turns completed trajectories into reusable sub-procedures invokable at intermediate execution states, a dual text-code representation that connects skill retrieval with executable action, and a state-grounded dynamic retrieval mechanism that matches skills to both the task goal and the current webpage state. Experiments on WebArena across five domains show that SGDR consistently outperforms strong baselines, achieving average success rates of 37.5% with GPT-4.1 and 24.3% with Qwen3-4B, corresponding to relative gains of 10.6% and 10.0% over the strongest baseline, respectively. The code is available at https://github.com/plusnli/skill-dynamic-retrieval.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。