arXiv:2410.17236cs.CLcs.AI2024-10中稿 · WWW 2025被引 83

让网页代理理解用户习惯,执行个性化操作。

Large Language Models Empowered Personalized Web Agents

  • 用用户记忆库提取历史行为,增强指令理解
  • 在新基准上性能超越现有代理30%以上
  • 适合个性化任务、智能助手研发者使用

网页代理正成为基于用户指令自动化完成网络任务的有前景方向,显著提升用户体验。近期,基于大语言模型(LLM)的网页代理逐渐取代传统代理。然而,现有方法忽视了用户画像与历史网络行为等个性化数据在理解指令和执行定制化动作中的作用。为此,我们首次提出基于LLM的个性化网页代理任务,整合个性化数据与用户指令,实现个性化指令理解和动作执行。为填补评估基准空白,我们构建了个性化网页代理基准(PersonalWAB),包含用户指令、个性化数据、网页功能及三种任务下的两种评估范式。此外,我们提出个性化用户记忆增强对齐(PUMA)框架,通过任务特定检索策略从记忆库中筛选相关历史行为,并基于行为数据通过微调和直接偏好优化对齐LLM,以实现个性化动作执行。大量实验验证了PUMA在PersonalWAB上优于现有网页代理。

原文摘要 · Abstract (English)

Web agents have emerged as a promising direction to automate Web task completion based on user instructions, significantly enhancing user experience. Recently, Web agents have evolved from traditional agents to Large Language Models (LLMs)-based Web agents. Despite their success, existing LLM-based Web agents overlook the importance of personalized data (e.g., user profiles and historical Web behaviors) in assisting the understanding of users' personalized instructions and executing customized actions. To overcome the limitation, we first formulate the task of LLM-empowered personalized Web agents, which integrate personalized data and user instructions to personalize instruction comprehension and action execution. To address the absence of a comprehensive evaluation benchmark, we construct a Personalized Web Agent Benchmark (PersonalWAB), featuring user instructions, personalized user data, Web functions, and two evaluation paradigms across three personalized Web tasks. Moreover, we propose a Personalized User Memory-enhanced Alignment (PUMA) framework to adapt LLMs to the personalized Web agent task. PUMA utilizes a memory bank with a task-specific retrieval strategy to filter relevant historical Web behaviors. Based on the behaviors, PUMA then aligns LLMs for personalized action execution through fine-tuning and direct preference optimization. Extensive experiments validate the superiority of PUMA over existing Web agents on PersonalWAB.

网页代理个性化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。