让网页智能体更聪明地删减页面信息,提升规划能力。
LineRetriever: Planning-Aware Observation Reduction for Web Agents
- 用语言模型挑选对下一步操作最相关的页面内容行
- 在保持性能前提下,将每步观察数据量减少40%以上
- 适合需要高效决策的网页自动化系统开发者
尽管大语言模型在网页导航任务中表现出色,但网页的完整上下文(如DOM或无障碍树结构)常超出模型的上下文长度限制。当前方法如自底向上截断或基于嵌入的检索,会丢失页面状态和操作历史的关键信息,这对自适应规划尤为不利。我们假设嵌入模型无法充分捕捉与计划相关的信息,尤其是在支持未来动作预测的内容检索方面。由此提出新方法LineRetriever:利用语言模型识别并检索最有助于未来导航步骤的观察行。不同于仅关注语义相似性的传统检索,LineRetriever显式考虑规划视野,优先选择对动作预测有贡献的元素。实验表明,该方法可在不降低性能的前提下,有效压缩每步观察内容,满足上下文长度约束。
原文摘要 · Abstract (English)
While large language models have demonstrated impressive capabilities in web navigation tasks, the extensive context of web pages, often represented as DOM or Accessibility Tree (AxTree) structures, frequently exceeds model context limits. Current approaches like bottom-up truncation or embedding-based retrieval lose critical information about page state and action history. This is particularly problematic for adaptive planning in web agents, where understanding the current state is essential for determining future actions. We hypothesize that embedding models lack sufficient capacity to capture plan-relevant information, especially when retrieving content that supports future action prediction. This raises a fundamental question: how can retrieval methods be optimized for adaptive planning in web navigation tasks? In response, we introduce \textit{LineRetriever}, a novel approach that leverages a language model to identify and retrieve observation lines most relevant to future navigation steps. Unlike traditional retrieval methods that focus solely on semantic similarity, \textit{LineRetriever} explicitly considers the planning horizon, prioritizing elements that contribute to action prediction. Our experiments demonstrate that \textit{LineRetriever} can reduce the size of the observation at each step for the web agent while maintaining consistent performance within the context limitations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。