arXiv:2602.14296cs.AIcs.SE2026-02被引 17

用有限状态机生成可验证的网页环境,让网页智能体训练更高效。

AutoWebWorld: Synthesizing Infinite Verifiable Web Environments via Finite State Machines

  • 将网页建模为有限状态机,明确状态与动作规则。
  • 自动生成1.16万条验证轨迹,每条成本仅0.04美元。
  • 合成数据量越大,真实任务表现越好,适合强化学习研究者。

自主网页界面代理的性能高度依赖训练数据的质量与数量。然而,从真实网站收集交互轨迹成本高且难以验证,因状态转移隐含,需依赖昂贵的外部验证器判断步骤正确性。为此,我们提出AutoWebWorld,一种通过有限状态机(FSM)建模并生成可控、可验证网页环境的新框架,并使用编码代理将FSM转化为可交互网站。与真实网站不同,AutoWebWorld显式定义所有状态、动作及转移规则,实现程序化验证:动作正确性依据预设规则判定,任务成功通过抵达目标状态确认。该框架支持全自动搜索与验证流程,在29个多样化网页环境中生成超11,663条验证轨迹,每条成本仅0.04美元。基于此合成数据训练的7B网页界面代理,在WebVoyager上15步内超越所有基线;同时观察到清晰的扩展规律:合成数据量越大,其在WebVoyager与Online-Mind2Web上的表现持续提升。

原文摘要 · Abstract (English)

The performance of autonomous Web GUI agents heavily relies on the quality and quantity of their training data. However, a fundamental bottleneck persists: collecting interaction trajectories from real-world websites is expensive and difficult to verify. The underlying state transitions are hidden, leading to reliance on inconsistent and costly external verifiers to evaluate step-level correctness. To address this, we propose AutoWebWorld, a novel framework for synthesizing controllable and verifiable web environments by modeling them as Finite State Machines (FSMs) and use coding agents to translate FSMs into interactive websites. Unlike real websites, where state transitions are implicit, AutoWebWorld explicitly defines all states, actions, and transition rules. This enables programmatic verification: action correctness is checked against predefined rules, and task success is confirmed by reaching a goal state in the FSM graph. AutoWebWorld enables a fully automated search-and-verify pipeline, generating over 11,663 verified trajectories from 29 diverse web environments at only $0.04 per trajectory. Training on this synthetic data significantly boosts real-world performance. Our 7B Web GUI agent outperforms all baselines within 15 steps on WebVoyager. Furthermore, we observe a clear scaling law: as the synthetic data volume increases, performance on WebVoyager and Online-Mind2Web consistently improves.

网页智能体有限状态机合成数据自动化验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。