arXiv:2606.09399cs.AI2026-06

让网页导航机器人像人一样浏览,靠的是模拟人类的看、想、动三阶段行为。

RunAgent SuperBrowser: A Theory of Autonomous Web Navigation Grounded in Human Browsing Behaviour

论文配图:RunAgent SuperBrowser: A Theory of Autonomous Web Navigation Grounded in Human Browsing Behaviour
图 1 · 摘自论文原文
  • 用视觉优先的候选框识别,让语言模型提前看到可点击区域。
  • 在Mind2Web Hard上达成89.47%成功率,远超现有开源基线。
  • 适合关注自主智能体认知架构与真实场景网页任务的读者。

我们提出SUPERBROWSER,一种基于单一核心假设的自主网页导航代理:网页代理应像人一样浏览。人类读取页面时不会记住每个像素,而是关注少数候选目标,选择其一,并仅保留维持目标所需信息。我们将这一感知-认知-行动循环建模为三个耦合机制:首先,视觉优先的边界框流水线对每张截图标注候选交互区域,并异步预加载至语言模型,实现“眼先于手”;其次,三角色大脑——调度器负责分类路由,规划器每几步评估进展,工作者生成每步动作——分离战略与操作推理;第三,结构化账本仅存储人类会记录的内容:目标、最近三次操作、少量事实与死胡同、以及少量检查点;六阶段淘汰循环系统性清理过时截图、状态块和推理痕迹。动作执行采用三层点击级联(Chrome DevTools Protocol → Puppeteer → 脚本),结合拟人化的贝塞尔运动,并引入箭头感知的边界框抓取机制,解决“小箭头旁大标签”的歧义问题。在66项任务的Mind2Web Hard基准上,超级浏览器取得89.47%的成功率,位列第三,大幅领先所有已发表的开源/研究级浏览器代理基线。我们认为,性能提升并非源于单一技巧,而在于系统性贯彻认知契约。

原文摘要 · Abstract (English)

We present SUPERBROWSER, an autonomous web-navigation agent designed against a single guiding hypothesis: a web agent should browse the way a person browses. A human reading a page does not retain every pixel they have seen; they look at a few candidate targets, decide on one, and remember only what is needed to keep the goal alive. We operationalize this perception-cognition-action triad as three coupled mechanisms. First, a vision-first bounding-box pipeline labels candidate interactive regions on every screenshot and feeds them, asynchronously prefetched, to the language model so that the "eye" precedes the "hand". Second, a three-role brain -- an Orchestrator that classifies and routes, a Planner that evaluates progress every few steps, and a Worker that emits per-step actions -- separates strategic from operational reasoning. Third, a structured Ledger stores only what a person would: the goal, the last three actions, a small set of facts and dead-ends, and a handful of checkpoints; a six-phase eviction loop systematically discards stale screenshots, state blobs, and reasoning traces from the live context. Action execution is a three-tier click cascade (Chrome DevTools Protocol to Puppeteer to scripted) with humanized Bezier motion, plus a chevron-aware bounding-box snapper that resolves the "small arrow beside a large label" ambiguity. On the Mind2Web Hard benchmark (66 tasks), SUPERBROWSER attains 89.47% success, placing third overall and ahead of every published open/research browser-agent baseline by a large margin. We argue that the gain comes not from any single trick but from the consistent application of a cognitive contract throughout the system.

自主导航认知架构网页代理人机一致

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。