arXiv:2509.21072cs.AI2025-09被引 4

让浏览器代理自我进化,自动修复错误并生成工具。

Recon-Act: A Self-Evolving Multi-Agent Browser-Use System via Web Reconnaissance, Tool Generation, and Task Execution

  • 分侦察与执行两团队,通过对比成败轨迹生成通用工具。
  • 在VisualWebArena上实现当前最佳性能,适配未见网站。
  • 闭环训练框架,减少试错,适合复杂网页任务研究者。

近年来,多模态模型在智能浏览器代理方面取得显著进展。然而,在真实网页上进行多轮、长周期任务时,现有代理仍存在动作顺序混乱和过度试错的问题。本文提出Recon-Act,一种基于侦察-行动范式的自进化多智能体框架。系统包含侦察团队与执行团队:前者进行对比分析并生成工具,后者负责意图分解、工具调度与执行。通过对比失败与成功轨迹,侦察团队推断修复方案,并将其抽象为统一的通用工具(以提示或规则代码形式),实时注册至工具库。执行团队借助这些针对性工具重新推理,形成数据-工具-行动-反馈的闭环训练流程。遵循本文提出的六级实施路线图,目前已达第3级(有限人工介入)。借助侦察获得的通用工具,Recon-Act显著提升对未见网站的适应性与长周期任务求解能力,在挑战性VisualWebArena数据集上达到当前最优表现。

原文摘要 · Abstract (English)

Recent years, multimodal models have made remarkable strides and pave the way for intelligent browser use agents. However, when solving tasks on real world webpages in multi-turn, long-horizon trajectories, current agents still suffer from disordered action sequencing and excessive trial and error during execution. This paper introduces Recon-Act, a self-evolving multi-agent framework grounded in Reconnaissance-Action behavioral paradigm. The system comprises a Reconnaissance Team and an Action Team: the former conducts comparative analysis and tool generation, while the latter handles intent decomposition, tool orchestration, and execution. By contrasting the erroneous trajectories with successful ones, the Reconnaissance Team infers remedies, and abstracts them into a unified notion of generalized tools, either expressed as hints or as rule-based codes, and register to the tool archive in real time. The Action Team reinference the process empowered with these targeting tools, thus establishing a closed-loop training pipeline of data-tools-action-feedback. Following the 6 level implementation roadmap proposed in this work, we have currently reached Level 3 (with limited human-in-the-loop intervention). Leveraging generalized tools obtained through reconnaissance, Recon-Act substantially improves adaptability to unseen websites and solvability on long-horizon tasks, and achieves state-of-the-art performance on the challenging VisualWebArena dataset.

浏览器代理多智能体自进化工具生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。