arXiv:2601.20162cs.CL2026-01ACL被引 4

让手机助手学会用户习惯,更懂你的模糊指令。

Me-Agent: A Personalized Mobile Agent with Two-Level User Habit Learning for Enhanced Interaction

  • 分两层学习用户习惯:指令层用偏好模型优化,记忆层存长期与应用偏好。
  • 在真实场景测试中,对模糊指令理解准确率显著提升,超越现有方法。
  • 适合需要个性化交互的智能助手开发者和研究者参考。

基于大语言模型的移动代理虽有显著进展,但常仅执行明确指令,忽视个性化需求,导致真实使用中存在三大问题:(1)难以理解模糊指令,(2)无法从交互历史中学习,(3)无法处理个性化请求。为此,我们提出 Me-Agent,一个可学习、可记忆的个性化移动代理。其采用两级用户习惯学习机制:在提示层,设计基于个人奖励模型的偏好学习策略以提升个性化表现;在记忆层,构建层次化偏好记忆,分别存储用户的长期习惯与特定应用偏好。为验证个性化能力,我们引入 User FingerTip,一个包含大量日常生活模糊指令的新基准。在 User FingerTip 及通用基准上的大量实验表明,Me-Agent 在个性化表现上达到当前最优水平,同时保持出色的指令执行能力。

原文摘要 · Abstract (English)

Large Language Model (LLM)-based mobile agents have made significant performance advancements. However, these agents often follow explicit user instructions while overlooking personalized needs, leading to significant limitations for real users, particularly without personalized context: (1) inability to interpret ambiguous instructions, (2) lack of learning from user interaction history, and (3) failure to handle personalized instructions. To alleviate the above challenges, we propose Me-Agent, a learnable and memorable personalized mobile agent. Specifically, Me-Agent incorporates a two-level user habit learning approach. At the prompt level, we design a user preference learning strategy enhanced with a Personal Reward Model to improve personalization performance. At the memory level, we design a Hierarchical Preference Memory, which stores users' long-term memory and app-specific memory in different level memory. To validate the personalization capabilities of mobile agents, we introduce User FingerTip, a new benchmark featuring numerous ambiguous instructions for daily life. Extensive experiments on User FingerTip and general benchmarks demonstrate that Me-Agent achieves state-of-the-art performance in personalization while maintaining competitive instruction execution performance.

个性化移动代理习惯学习大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。