一个策略搞定任意人数团队协作搬运,动作真实自然。
TeamHOI: Learning a Unified Policy for Cooperative Human-Object Interactions with Any Team Size
- 用带队友标记的Transformer网络实现分布式协作控制。
- 在2到8人团队中成功率超90%,支持不同物体形状。
- 适合需要多智能体协同的仿真或机器人应用。
基于物理的类人控制在单智能体行为上已取得显著进展,但扩展至多人协作的人-物交互(HOI)仍具挑战。本文提出TeamHOI框架,使单一去中心化策略可处理任意规模团队的协作HOI。各智能体仅使用局部观测,通过包含队友标记的Transformer策略网络实现跨团队规模的可扩展协调。为提升动作真实性并缓解协作数据稀缺问题,引入掩码对抗运动先验(AMP)策略:训练时以单人参考动作为基础,掩码与物体交互的身体部位,再由任务奖励引导生成多样且物理合理的协作行为。我们在涉及2至8名类人智能体及多种物体几何形状的协作搬运任务上评估该方法。为确保稳定搬运,设计了与团队规模和物体形状无关的编队奖励机制。TeamHOI在多种配置下均实现高成功率,展现出一致的协作能力,仅用单一策略完成所有任务。
原文摘要 · Abstract (English)
Physics-based humanoid control has achieved remarkable progress in enabling realistic and high-performing single-agent behaviors, yet extending these capabilities to cooperative human-object interaction (HOI) remains challenging. We present TeamHOI, a framework that enables a single decentralized policy to handle cooperative HOIs across any number of cooperating agents. Each agent operates using local observations while attending to other teammates through a Transformer-based policy network with teammate tokens, allowing scalable coordination across variable team sizes. To enforce motion realism while addressing the scarcity of cooperative HOI data, we further introduce a masked Adversarial Motion Prior (AMP) strategy that uses single-human reference motions while masking object-interacting body parts during training. The masked regions are then guided through task rewards to produce diverse and physically plausible cooperative behaviors. We evaluate TeamHOI on a challenging cooperative carrying task involving two to eight humanoid agents and varied object geometries. Finally, to promote stable carrying, we design a team-size- and shape-agnostic formation reward. TeamHOI achieves high success rates and demonstrates coherent cooperation across diverse configurations with a single policy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。