arXiv:2410.13825cs.AIcs.CL2024-10ICLR被引 126

通过优化观察与动作空间,让大模型网页代理零样本高效完成复杂任务。

AgentOccam: A Simple Yet Strong Baseline for LLM-Based Web Agents

论文配图:AgentOccam: A Simple Yet Strong Baseline for LLM-Based Web Agents
图 1 · 摘自论文原文
  • 简化代理设计,仅调整观察和动作空间以匹配大模型能力。
  • 在WebArena上超越当前最佳方法9.8分(+29.4%),成功率提升161%。
  • 无需提示示例或额外策略,适合追求简洁高效的工程落地者。

基于大语言模型(LLM)的自主代理能提升个性化、标准化任务的人类效率。自动化网络任务(如预算内预订酒店)需求日益增长,同时作为多种代理具身化场景的验证范例,其成功将推动未来广泛应用。以往研究常依赖人工设计的策略(如提示模板、多智能体系统、搜索方法等)及上下文示例,泛化能力有限。此外,现有工作较少关注代理的观察/动作表示与大模型预训练数据之间的不匹配问题——尤其当大模型主要训练于文本补全而非涉及具身导航与符号网页元素的任务时。本文通过简单重构观察与动作空间,使其更契合大模型能力,显著提升代理性能。在涵盖通用网络交互任务的WebArena基准上,所提代理AgentOccam分别以9.8分(+29.4%)和5.9分(+15.8%)超越前人最优及同期工作,并使成功率相较同类基础代理提升26.6点(+161%)。该成果不依赖上下文示例、新角色、在线反馈或搜索策略。结果凸显大模型在网页任务上的强大零样本能力,强调精心设计观察与动作空间对基于大模型代理的关键作用。

原文摘要 · Abstract (English)

Autonomy via agents using large language models (LLMs) for personalized, standardized tasks boosts human efficiency. Automating web tasks (like booking hotels within a budget) is increasingly sought after. Fulfilling practical needs, the web agent also serves as an important proof-of-concept example for various agent grounding scenarios, with its success promising advancements in many future applications. Prior research often handcrafts web agent strategies (e.g., prompting templates, multi-agent systems, search methods, etc.) and the corresponding in-context examples, which may not generalize well across all real-world scenarios. On the other hand, there has been limited study on the misalignment between a web agent's observation/action representation and the pre-training data of the LLM it's based on. This discrepancy is especially notable when LLMs are primarily trained for language completion rather than tasks involving embodied navigation actions and symbolic web elements. Our study enhances an LLM-based web agent by simply refining its observation and action space to better align with the LLM's capabilities. This approach enables our base agent to significantly outperform previous methods on a wide variety of web tasks. Specifically, on WebArena, a benchmark featuring general-purpose web interaction tasks, our agent AgentOccam surpasses the previous state-of-the-art and concurrent work by 9.8 (+29.4%) and 5.9 (+15.8%) absolute points respectively, and boosts the success rate by 26.6 points (+161%) over similar plain web agents with its observation and action space alignment. We achieve this without using in-context examples, new agent roles, online feedback or search strategies. AgentOccam's simple design highlights LLMs' impressive zero-shot performance on web tasks, and underlines the critical role of carefully tuning observation and action spaces for LLM-based agents.

大模型代理网页自动化零样本基准优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。