统一智能体跨设备持续管理用户任务,提升多场景协作效率
Unified Agent: Managing Interactions across Devices

- 设计可跨设备携带的紧凑状态,整合交互证据与待办请求
- 在多设备任务中显著优于四种现有系统,性能随模型变化保持领先
- 适合构建跨平台、长时程智能助手,如家庭自动化或个人助理
随着能力不断提升,人工智能代理正从单一应用内运行转向跨用户设备协同。然而现有系统仍存在不足:观察信息分散在不同设备和时间点,主流系统要么将设备视为工具而缺乏全局状态管理,要么采用多代理协作却无法维持跨设备、跨时间请求所需的紧凑状态。本文主张代理应维护一个高效组织的紧凑状态,包含交互证据、陈述事实与当前请求,以支持基于当前观察的决策。为评估状态设计,我们构建了跨设备与时间的用户-代理交互基准。在此基础上提出 Unified Agent,一个能携带交互证据跨越设备与时间点,并结合当前观察执行动作的状态化代理。默认设置下,其显著优于四种已有设计的变体;在更换多模态大语言模型家族、功能能力和推理开销等条件下,仍持续领先所有对比系统,表明该状态设计优势具有鲁棒性。代码与数据将公开于 GitHub。
原文摘要 · Abstract (English)
As capabilities rapidly increase, AI agents can move from running inside one app to acting across a user's devices over time. Yet existing agent systems still fall short in this scenario. This is because observations are scattered across devices and moments, but mainstream systems are not designed around this fact: a single agent that treats devices as tools lacks effective state management for all devices across time, and multi-agent systems coordinate across agents but do not maintain the compact carried state a cross-device, cross-time request needs. We argue that the agent should maintain an effectively designed state that organizes engagement evidence, stated facts, and the standing request in a compact, action-ready form for deciding its action given the current observation. To compare state designs, we construct a benchmark of user-agent interaction across devices and time. We instantiate this principle in Unified Agent, a stateful agent that carries interaction evidence across devices and moments and uses it with the current observation to act. In the default setting, it significantly outperforms our adaptations of four published designs. Across changes in multimodal large language model (MLLM) family, capability, and reasoning effort, it remains ahead of all compared systems, demonstrating that the state-design advantage is robust across MLLM settings. Our code and data will be publicly available on GitHub.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。