用高质量合成数据提升网页智能体对新网站的适应能力。
SynthAgent: Adapting Web Agents with Synthetic Supervision
- 通过分类探索网页元素生成多样化任务,提升覆盖率。
- 仅在观察冲突时才修正任务,减少幻觉并保持一致性。
- 结合全局上下文优化轨迹,适合想快速部署网页代理的开发者。
网页智能体因缺乏特定环境的任务和示范数据,难以适应新网站。现有合成数据方法存在质量缺陷:生成的任务含无法执行的幻觉,收集的轨迹则存在噪声、冗余或动作错位。本文提出SynthAgent,一种全合成监督框架,通过任务与轨迹的双重优化提升数据质量。首先,基于网页元素的分类探索生成多样任务,确保对目标环境的有效覆盖;轨迹收集过程中,仅在观测与任务冲突时才进行任务修正,避免幻觉同时维持任务一致性;收集后,利用全局上下文对轨迹进行优化,消除潜在噪声或错位。最后,在高质量合成数据上微调开源网页智能体,使其适配目标环境。实验表明,SynthAgent优于现有合成数据方法,验证了高质量合成监督的重要性。代码已公开于https://github.com/aiming-lab/SynthAgent。
原文摘要 · Abstract (English)
Web agents struggle to adapt to new websites due to the scarcity of environment specific tasks and demonstrations. Recent works have explored synthetic data generation to address this challenge, however, they suffer from data quality issues where synthesized tasks contain hallucinations that cannot be executed, and collected trajectories are noisy with redundant or misaligned actions. In this paper, we propose SynthAgent, a fully synthetic supervision framework that aims at improving synthetic data quality via dual refinement of both tasks and trajectories. Our approach begins by synthesizing diverse tasks through categorized exploration of web elements, ensuring efficient coverage of the target environment. During trajectory collection, tasks are refined only when conflicts with observations are detected, which mitigates hallucinations while preserving task consistency. After collection, we conduct trajectory refinement with global context to mitigate potential noise or misalignments. Finally, we fine-tune open-source web agents on the refined synthetic data to adapt them to the target environment. Experimental results demonstrate that SynthAgent outperforms existing synthetic data methods, validating the importance of high-quality synthetic supervision. The code is publicly available at https://github.com/aiming-lab/SynthAgent.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。