arXiv:2609.06591cs.ROcs.GR2026-09

统一人体模型交互的物理驱动框架,实现复杂场景下的运动与操作无缝衔接。

Unifying Physics-Based Humanoid Interaction with a Context-Conditioned Interaction Prior

论文配图:Unifying Physics-Based Humanoid Interaction with a Context-Conditioned Interaction Prior
图 1 · 摘自论文原文
  • 基于上下文条件的交互先验,从异构数据中学习可复用的运动技能
  • 三阶段训练:模仿学习→行为蒸馏→强化学习微调,支持长时序任务
  • 适用于需要环境感知和多步操作的复杂交互任务,如搬运与序列动作

构建能应对复杂3D场景并操控物体的统一物理驱动人体模型控制器仍是长期挑战。现有方法通常仅擅长运动或物体操作,或依赖任务特异性奖励设计,难以扩展至多样化行为。本文提出CHIP,一种从异构运动数据中学习可复用人体交互技能的统一物理框架。核心是上下文相关的交互先验,其在共享离散空间中建模技能的条件分布。方法分三阶段训练:首先通过物理驱动的运动模仿学习,从异构交互数据中获取具身教师行为;随后将这些行为蒸馏为上下文感知的交互先验,捕捉运动与操作间的共性结构;最后以预训练先验初始化下游任务策略,并通过先验正则化的在线强化学习进行微调。在多样化人体交互任务上验证,该方法支持场景感知运动、接触丰富的物体操作,以及环境感知搬运、长时序技能组合等复合行为,且生成平滑自然、物理合理的运动轨迹。

原文摘要 · Abstract (English)

Developing unified physics-based humanoid controllers that can navigate complex 3D scenes and manipulate objects remains a longstanding challenge. Existing approaches are often specialized for either locomotion or object-centric manipulation, or rely on task-specific reward engineering that does not scale well across diverse behaviors. We present CHIP, a unified, physics-grounded framework for learning reusable humanoid interaction skills from heterogeneous motion data. Central to our approach is a conditional interaction prior that models a context-dependent distribution over these skills within a shared discrete space. Our method is trained in three stages. We first learn physics-based motion-imitation policies that acquire grounded teacher behaviors from heterogeneous interaction data. We then distill these behaviors into a context-conditioned interaction prior that captures reusable motion structure across locomotion and manipulation. Finally, we initialize downstream task policies from the pretrained prior and adapt them through prior-regularized online RL post-training. Experiments on a diverse suite of humanoid interaction tasks show that our approach supports scene-aware locomotion, contact-rich object manipulation, and compositional behaviors such as environment-aware object transport and long-horizon skill sequencing, while producing smooth transitions and physically plausible motion.

人体模型物理仿真技能复用强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。