arXiv:2607.10408cs.CV2026-07

提出GNOCHI模型,生成真实且无碰撞的3D人体互动动作。

GNOCHI: Generative Neural mOdel for Close Human-Human Interactions

论文配图:GNOCHI: Generative Neural mOdel for Close Human-Human Interactions
图 1 · 摘自论文原文
  • 用条件变分自编码器生成一人动作时考虑另一人姿态。
  • 在自动生成的交互数据上训练,解决数据稀缺问题。
  • 通过体积代理自监督损失,确保动作物理合理性,适合虚拟角色交互场景。

在虚拟环境中生成真实的3D人体互动动作极具挑战,因人体自由度高且需避免相互碰撞。传统方法依赖运动捕捉或3D重建,缺乏生成能力;现有生成方法虽能通过文本或图像合成动作,但难以建模近距离互动。本文提出GNOCHI模型,基于条件变分自编码器(cVAE),实现一人动作基于另一人姿态的生成,支持可控且多样化的互动合成。为解决数据稀缺问题,提出自动化监督数据增强策略,生成逼真的合成交互姿态;针对生成过程中的碰撞问题,设计基于体积代理的自监督损失,结合碰撞化解技术,确保动作物理正确性。实验验证模型可生成大量合理且无碰撞的互动动作,超越现有最先进方法的能力。

原文摘要 · Abstract (English)

Creating realistic 3D human-human interactions in virtual environments is challenging due to the high degrees of freedom in the human body and the need for physically accurate poses that do not collide with each other. Traditional methods for human-human interaction are based on motion tracking or 3D body reconstruction, but lack generative capabilities. Recent generative methods enable the synthesis of individual or interacting motions via text or image input, but generally fall short in modeling close interactions. This paper introduces a novel generative model for close 3D human-human interactions using a conditional variational autoencoder (cVAE), which generates poses for one human conditioned on the pose of another, allowing for controlled and diverse interaction synthesis. To train our model, we address two underlying long-standing challenges in the field of human-human interaction: data scarcity, for which we propose an automated supervised data augmentation strategy that generates synthetic yet realistic interaction poses; and collision awareness in generative approaches, for which we propose a self-supervised loss based on a collision resolution technique using volumetric proxies to ensure physically correct interactions. We extensively evaluate the capabilities of our model, and demonstrate a wide variety of plausible and physically correct interactions, not possible to generate with current state-of-the-art methods.

3D生成人体互动生成模型物理约束

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。