用合成数据训练出能在设备上运行的高效电脑操作智能体
Fara-7B: An Efficient Agentic Model for Computer Use
- 用自动生成的网页任务数据训练,支持多步操作
- 在多个基准测试中优于同规模模型,接近大模型表现
- 适合资源受限场景下的轻量级智能体应用
计算机使用智能体(CUA)的发展受限于缺乏大规模高质量的人机交互轨迹数据。尽管大语言模型依赖海量文本数据,但目前尚无类似语料库用于CUA。为此,我们提出FaraGen,一种面向多步网页任务的新型合成数据生成系统,能从常用网站生成多样化任务、多轮求解尝试,并通过多重验证器筛选成功轨迹,实现高吞吐、高产出和高多样性,每条验证轨迹成本约1美元。基于该数据,我们训练了Fara-7B——一个原生计算机使用智能体,仅通过截图感知环境,根据预测坐标执行动作,且模型小巧可本地运行。实验表明,Fara-7B在WebVoyager、Online-Mind2Web及新提出的WebTailBench(更全面覆盖未被充分代表的网页任务)等基准上表现优异,优于同规模其他模型,且媲美更大规模前沿模型,凸显可扩展数据生成对小型高效智能体的关键作用。Fara-7B已开源至Microsoft Foundry与HuggingFace,WebTailBench数据集同步发布。
原文摘要 · Abstract (English)
Progress in computer use agents (CUAs) has been constrained by the absence of large and high-quality datasets that capture how humans interact with a computer. While LLMs have thrived on abundant textual data, no comparable corpus exists for CUA trajectories. To address these gaps, we introduce FaraGen, a novel synthetic data generation system for multi-step web tasks. FaraGen can propose diverse tasks from frequently used websites, generate multiple solution attempts, and filter successful trajectories using multiple verifiers. It achieves high throughput, yield, and diversity for multi-step web tasks, producing verified trajectories at approximately $1 each. We use this data to train Fara-7B, a native CUA model that perceives the computer using only screenshots, executes actions via predicted coordinates, and is small enough to run on-device. We find that Fara-7B outperforms other CUA models of comparable size on benchmarks like WebVoyager, Online-Mind2Web, and WebTailBench -- our novel benchmark that better captures under-represented web tasks in pre-existing benchmarks. Furthermore, Fara-7B is competitive with much larger frontier models, illustrating key benefits of scalable data generation systems in advancing small efficient agentic models. We are making Fara-7B open-weight on Microsoft Foundry and HuggingFace, and we are releasing WebTailBench.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。