让AI像人一样操作网页,直接点击滚动,提升复杂任务解答能力。
BrowserAgent: Building Web Agents with Human-Inspired Web Browsing Actions
- 直接操控原始网页,模拟人类浏览动作完成任务
- 仅用少量数据训练,多跳问答任务性能比Search-R1高20%
- 加入记忆机制,适合长流程推理和复杂网页交互
高效解决现实问题越来越依赖大模型与动态网页环境的交互能力。尽管近期研究如Search-R1和WebDancer在网页任务上表现良好,但它们依赖额外工具将交互式网页转化为静态文本,偏离了人类浏览行为。本文提出BrowserAgent,一种通过模拟人类浏览动作(如滚动、点击、输入)直接操作原始网页的更互动智能体。该系统基于Playwright执行预定义浏览器操作,并采用两阶段训练(监督微调与拒绝微调)提升泛化能力。尽管训练数据远少于Search-R1,BrowserAgent在多个Open-QA任务中表现更优。我们引入显式记忆机制,用于存储各步骤的关键结论,显著增强长周期任务的推理能力。值得注意的是,BrowserAgent-7B在HotpotQA、2Wiki、Bamboogle等多跳问答任务上相较Search-R1提升约20%。结果表明,BrowserAgent可作为更具交互性与可扩展性的下一代网页智能体框架。
原文摘要 · Abstract (English)
Efficiently solving real-world problems with LLMs increasingly hinges on their ability to interact with dynamic web environments and autonomously acquire external information. While recent research like Search-R1 and WebDancer demonstrates strong performance in solving web tasks, they heavily rely on additional tools to convert the interactive web environment into static text content. This is in contrast to human browsing behaviors, which involve diverse interactions with the browser, such as scrolling, clicking, and typing. In this paper, we propose BrowserAgent, a more interactive agent that solves complex tasks through human-inspired browser actions. BrowserAgent operates directly on raw web pages via Playwright through a set of predefined browser actions. We adopt a two-stage training (Supervised Fine-Tuning (SFT) and Rejection Fine-Tuning (RFT)) to improve the model's generalization abilities. Despite using significantly less training data than Search-R1, BrowserAgent achieves more competitive results across different Open-QA tasks. Additionally, we introduce an explicit memory mechanism to store key conclusions across steps, further enhancing the model's reasoning capabilities for long-horizon tasks. Notably, BrowserAgent-7B can achieve around 20\% improvement over Search-R1 on multi-hop QA tasks like HotpotQA, 2Wiki, and Bamboogle. These results indicate that BrowserAgent can serve as a more advanced framework for more interactive and scalable web agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。