让网页智能体自动提炼并递归组合技能,持续自我进化。
SCAFFOLD: Self-Improving Web Agents via Recursive Parametric Skill Abstraction

- 从成功操作中提取可执行的参数化技能,按层级递归组合。
- 在多个数据集上提升11.1~17.2个百分点成功率,五轮迭代无退化。
- 适合需要长期任务规划的自动化网页交互场景。
网页智能体需应对视觉丰富、长时程且跨站点变化的界面,但以往方法多孤立学习任务,忽略积累的流程知识。现有技能增强框架虽有进展,却将技能库视为扁平或两级提示缓存,缺乏压缩冗余与递归组合的合理机制。本文提出 extsc{Scaffold},一种自进化的视觉网页智能体框架:(i) 在多实例抽象约束下,从成功轨迹中诱导出参数化可执行技能;(ii) 构建高层技能调用低层技能的递归层次结构;(iii) 通过最小描述长度(MDL)准则和行为等价性检查压缩技能库;(iv) 定期将技能增强轨迹蒸馏回模型权重,内化抽象。在 WebArena、VisualWebArena 及 Online-Mind2Web 的保留测试集上, extsc{Scaffold} 相比最强基线提升 11.1–17.2 绝对百分点成功率,并在五轮自改进迭代中保持单调增长,未出现库坍塌。代码与文档已开源。
原文摘要 · Abstract (English)
Web agents need to navigate visually rich, long-horizon interfaces that change across sites, yet most previous agents still learn each task in isolation and discard the procedural knowledge they accumulate. Recent skill-augmented frameworks take an important first step, but they treat the skill library as a flat or two-tier prompt-side cache and offer no principled mechanism for compressing redundancy or composing skills recursively. We introduce \textsc{Scaffold}, a self-improving framework for visual web agents that (i) induces parametric, executable skills from successful trajectories under a multi-instance abstraction constraint, (ii) maintains a recursively composed hierarchy in which higher-level skills invoke lower-level ones, (iii) compacts the library via a minimum-description-length (MDL) criterion and behavioral equivalence checking, and (iv) periodically distills skill-augmented trajectories back into model weights to internalize the abstractions. Across WebArena, VisualWebArena, and a held-out split of Online-Mind2Web, \textsc{Scaffold} improves success rate by $11.1$--$17.2$ absolute points over the strongest skill-augmented baseline and shows monotonic gains across five self-improvement iterations without library collapse. We release the code and documents in the Github \href{https://github.com/BokwaiHo/SCAFFOLD}{repository}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。