让机器人理解有身体限制的人并协作完成家务,提升人机共融能力。
Constrained Human-AI Cooperation: An Inclusive Embodied Social Intelligence Challenge
- 通过观察人类行为推断其意图与限制,实现社会感知。
- 设计8个长周期任务,涵盖室内外场景与突发风险,测试协作效率。
- 融合大模型与行为建模,适合研究具身智能与人机协作的学者。
我们提出受限人机协作(CHAIC)——一项面向具身智能体的社会感知与协作能力评估挑战。在该挑战中,具身智能体需基于第一视角观测,协助因身体限制(如无法触及高处或使用轮椅)而行动不便的人类完成日常家居或户外任务,目标是尽可能高效地协同完成。成功助手必须:(1) 通过跟随和观察人类行为,推断其意图与约束(社会感知);(2) 制定针对人类特性的协作计划,以最快速度完成任务(协作规划)。为评测该挑战,我们构建了4种具有真实物理限制的智能体,以及8个包含室内外场景、多种约束、突发事件和潜在风险的长周期任务。我们在该基准上评估了基于规划与学习的基线方法,并提出一种结合大语言模型与行为建模的新方法。实证结果表明,该基准能系统性评估机器社会智能的关键方面。基准与代码已公开于 https://github.com/UMass-Embodied-AGI/CHAIC。
原文摘要 · Abstract (English)
We introduce Constrained Human-AI Cooperation (CHAIC), an inclusive embodied social intelligence challenge designed to test social perception and cooperation in embodied agents. In CHAIC, the goal is for an embodied agent equipped with egocentric observations to assist a human who may be operating under physical constraints -- e.g., unable to reach high places or confined to a wheelchair -- in performing common household or outdoor tasks as efficiently as possible. To achieve this, a successful helper must: (1) infer the human's intents and constraints by following the human and observing their behaviors (social perception), and (2) make a cooperative plan tailored to the human partner to solve the task as quickly as possible, working together as a team (cooperative planning). To benchmark this challenge, we create four new agents with real physical constraints and eight long-horizon tasks featuring both indoor and outdoor scenes with various constraints, emergency events, and potential risks. We benchmark planning- and learning-based baselines on the challenge and introduce a new method that leverages large language models and behavior modeling. Empirical evaluations demonstrate the effectiveness of our benchmark in enabling systematic assessment of key aspects of machine social intelligence. Our benchmark and code are publicly available at https://github.com/UMass-Embodied-AGI/CHAIC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。