让机器人快速理解用户隐含需求,实现高效协作。
Communication-Efficient Desire Alignment for Embodied Agent-Human Adaptation
- 基于心理推理机制识别用户意图,过滤无关动作。
- 通过反思式通信减少冗余提问,提升信息复用率。
- 适用于人机协作场景,尤其适合复杂任务适应。
尽管具身智能体在执行复杂物理任务方面取得显著进展,但现实应用不仅要求完成任务,还需与陌生人类用户协作,而用户的意图常模糊且隐含。在此背景下,准确解析模糊指令、揭示潜在需求成为有效协助的关键。为此,本文构建了家用辅助仿真环境 HA-Desire,集成由大模型驱动的代理用户,模拟真实的价值导向目标选择与沟通行为。自主智能体需与该代理用户交互以推断并适配其潜在需求。为此,提出 FAMER 框架,引入基于欲望的心理推理机制以识别用户意图,并过滤无关动作;设计反思式通信模块以减少重复询问;结合目标相关的信息提取与记忆持久化,提升信息复用性并降低无效探索。大量实验表明,该框架显著提升任务执行与通信效率,使具身智能体能在复杂环境中快速适应用户特定需求。
原文摘要 · Abstract (English)
While embodied agents have made significant progress in performing complex physical tasks, real-world applications demand more than pure task execution. The agents must collaborate with unfamiliar agents and human users, whose goals are often vague and implicit. In such settings, interpreting ambiguous instructions and uncovering underlying desires is essential for effective assistance. Therefore, fast and accurate desire alignment becomes a critical capability for embodied agents. In this work, we first develop a home assistance simulation environment HA-Desire that integrates an LLM-driven proxy human user exhibiting realistic value-driven goal selection and communication. The ego agent must interact with this proxy user to infer and adapt to the user's latent desires. To achieve this, we present a novel framework FAMER for fast desire alignment, which introduces a desire-based mental reasoning mechanism to identify user intent and filter desire-irrelevant actions. We further design a reflection-based communication module that reduces redundant inquiries, and incorporate goal-relevant information extraction with memory persistence to improve information reuse and reduce unnecessary exploration. Extensive experiments demonstrate that our framework significantly enhances both task execution and communication efficiency, enabling embodied agents to quickly adapt to user-specific desires in complex embodied environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。