让网页智能体按功能区域理解页面,更高效准确。
Region4Web: Rethinking Observation Space Granularity for Web Agents

- 将网页分解为功能区域,替代逐元素观察
- 在WebArena上缩短观察长度,提升任务成功率
- 适合追求高效网页交互的LLM代理开发者
网页智能体通过观察空间感知网页,但其粒度设计长期被忽视。现有方法将观察与动作空间保持相同元素级粒度,使页面的功能结构隐含,迫使智能体每步从元素信号中推断。我们提出Region4Web框架,通过层级分解与语义抽象将AXTree重组为功能区域,显式暴露页面的功能组织结构。同时提出PageDigest——一种面向网页的推理流程,将区域级观察压缩为跨步骤持久的页面摘要。在WebArena基准测试中,PageDigest显著缩短观察长度,且在多种骨干大语言模型和代理方法下均提升任务成功率,无论模型能力如何。结果表明,以功能区域为粒度的观察比单纯元素级处理更具紧凑性与信息量。
原文摘要 · Abstract (English)
Web agents perceive web pages through an observation space, yet its granularity has remained an underexamined design choice. Existing work treats observation at the same element-level granularity as the action space, leaving the page's functional organization implicit and forcing the agent to infer it from element-level signals at every step. We argue observation should instead operate at the granularity of functional regions, parts of the page that each serve a distinct purpose. We propose Region4Web, a framework that reorganizes the AXTree into functional regions through hierarchical decomposition and semantic abstraction, exposing the page's functional organization as the basis for page state understanding. Moreover, we propose PageDigest, a web-specific inference pipeline that delivers this region-level observation to the actor agent as a compact per-page digest that persists across steps. On the WebArena benchmark, PageDigest substantially reduces observation length while improving overall task success rate across diverse backbone large language models (LLMs) and established agent methods, regardless of backbone capacity. These results show that operating at the granularity of functional regions delivers a more compact and informative basis for the actor agent than element-level processing alone.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。