用并行浏览器沙箱大规模生成网页交互数据,提升智能体泛化能力。
BrowserForge: Scaling Web Episode via Parallel Browser Sandboxes

- 通过并行沙箱和开放网页采样,自动生成海量真实网站交互数据。
- 构建20万条独立轨迹数据集,使模型在在线任务中成功率提升至33.33%。
- 适合研究网页智能体、强化学习数据生成及多模态训练的开发者。
从渲染像素驱动的网页智能体避免了解析HTML或无障碍树带来的脆弱性与高成本,但其训练依赖大量高质量交互轨迹,而如何规模化生成此类数据仍是未解难题。现有公开数据集通常仅包含数千条来自固定有限网站的轨迹,即使近期自动化合成管道也受限于预设网站列表或教程来源,导致智能体接触到的网站数量增长缓慢。本文提出BrowserForge框架,通过在开放网络上并行驱动数百个浏览器沙箱,实现网页交互数据的大规模生成。该框架包含三个组件:开放网络采样阶段让智能体接触数十万真实可访问网站;沙箱集群管理器实现高利用率的并发浏览器调度;提议-求解双智能体循环将原始页面转化为可执行任务并收集验证后的轨迹。一条规则+模型的清洗流水线剔除失败运行,并将剩余推理过程统一为连贯思维链。页面结构(如无障碍树)仅在合成阶段使用;最终训练并发布的智能体完全基于截图决策。最终数据集包含203,238条轨迹,每条来自不同网站,规模与多样性均超越此前数据集。在该数据集上微调小型多模态模型后,其在Live Online-Mind2Web上的成功率从25.66%提升至33.33%,并在静态Multimodal-Mind2Web上持续提升步骤准确率,且效果随数据集规模增大而增强。受控分析进一步证实,开放网络采样与广泛网站覆盖是性能提升的关键因素。
原文摘要 · Abstract (English)
Web agents that act from rendered pixels avoid the fragility and heavy token cost of reading a page's HTML or accessibility tree, but training them depends on large amounts of high-quality interaction trajectories, and how to produce such data at scale remains an open problem. Public datasets typically contain only a few thousand trajectories drawn from a fixed and narrow set of websites, and even recent automated synthesis pipelines stay bound to predefined site lists or tutorial sources, so the number of distinct websites the agent ever sees barely grows. We present BrowserForge, a framework that generates web interaction data at scale by driving many browser sandboxes in parallel over the open web. BrowserForge couples three components: an open-web sourcing stage that exposes the agent to hundreds of thousands of real, openly reachable websites; a sandbox cluster manager that schedules hundreds of concurrent browsers with high utilization; and a Proposer-Solver dual-agent loop that turns a raw page into an executable task and then collects a verified trajectory for it. A rule-plus-model cleaning pipeline removes failed runs and rewrites the surviving reasoning into a single unified chain-of-thought style. Page structure such as the accessibility tree is used only as a synthesis-time signal; the agent we train and release acts purely from the screenshot. The resulting corpus contains 203,238 trajectories, each collected from a distinct website, larger and more diverse than prior trajectory datasets. Fine-tuning a compact multimodal model on this corpus raises its success rate on the live Online-Mind2Web from 25.66% to 33.33% and consistently improves step accuracy on the static Multimodal-Mind2Web, with the gain growing as the corpus scales. Controlled analyses further confirm that open-web sourcing and broad website coverage are key contributors to the observed improvement.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。