实时生成逼真人机交互动作,解决响应速度与物理合理性矛盾
Towards Immersive Human-X Interaction: A Real-Time Framework for Physically Plausible Motion Synthesis
- 用自回归反应扩散规划器同步预测动作与反应
- 在Inter-X和InterHuman数据集上显著提升动作连贯性与物理真实性
- 适合虚拟现实、人形机器人等需要安全互动的场景
实时生成符合物理规律的人机交互动作,仍是沉浸式虚拟现实(VR/AR)系统与人形机器人的重要挑战。现有方法虽在运动学生成方面取得进展,却难以兼顾实时响应、物理可行性与安全性。本文提出Human-X框架,实现人-虚拟体、人-人形机器人及人-机器人等多种交互场景下的沉浸式、物理逼真动作合成。不同于依赖事后对齐或简化物理的方法,本方案通过自回归反应扩散规划器,实时联合预测动作与反应,确保同步性与上下文感知响应。为增强物理真实性和安全性,引入基于强化学习训练的演员感知运动追踪策略,动态适应交互对象运动,避免脚滑、穿模等伪影。在Inter-X和InterHuman数据集上的大量实验表明,该方法在动作质量、交互连续性和物理合理性上均优于当前最优方法。框架已在真实应用场景中验证,包括人-机器人交互的虚拟现实界面,展现出推动人机协作的潜力。
原文摘要 · Abstract (English)
Real-time synthesis of physically plausible human interactions remains a critical challenge for immersive VR/AR systems and humanoid robotics. While existing methods demonstrate progress in kinematic motion generation, they often fail to address the fundamental tension between real-time responsiveness, physical feasibility, and safety requirements in dynamic human-machine interactions. We introduce Human-X, a novel framework designed to enable immersive and physically plausible human interactions across diverse entities, including human-avatar, human-humanoid, and human-robot systems. Unlike existing approaches that focus on post-hoc alignment or simplified physics, our method jointly predicts actions and reactions in real-time using an auto-regressive reaction diffusion planner, ensuring seamless synchronization and context-aware responses. To enhance physical realism and safety, we integrate an actor-aware motion tracking policy trained with reinforcement learning, which dynamically adapts to interaction partners' movements while avoiding artifacts like foot sliding and penetration. Extensive experiments on the Inter-X and InterHuman datasets demonstrate significant improvements in motion quality, interaction continuity, and physical plausibility over state-of-the-art methods. Our framework is validated in real-world applications, including virtual reality interface for human-robot interaction, showcasing its potential for advancing human-robot collaboration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。