分离人体与物体运动建模,提升交互预测精度
CoopDiff: Anticipating 3D Human-object Interactions via Contact-consistent Decoupled Diffusion
- 分两支独立建模人体动作与物体运动,通过接触点关联
- 在BEHAVE和HOI数据集上显著超越现有方法
- 适合关注3D交互预测与物理一致性研究者
3D人体-物体交互预测旨在根据历史信息预判人体及其操作物体的未来运动。通常,人体作为可动结构与刚性物体具有不同的运动特性,但现有方法常将其混合建模。本文提出接触一致的解耦扩散框架CoopDiff,采用双分支结构分别建模人体与物体运动,并以共享接触点为锚点实现跨分支连接。人体分支预测结构化动作,物体分支专注于刚体平移与旋转。通过接触点一致性约束,确保人物运动协同。进一步设计人体驱动交互模块,引导物体运动建模。在BEHAVE与Human-object Interaction数据集上的大量实验表明,CoopDiff优于当前最先进方法。
原文摘要 · Abstract (English)
3D human-object interaction (HOI) anticipation aims to predict the future motion of humans and their manipulated objects, conditioned on the historical context. Generally, the articulated humans and rigid objects exhibit different motion patterns, due to their distinct intrinsic physical properties. However, this distinction is ignored by most of the existing works, which intend to capture the dynamics of both humans and objects within a single prediction model. In this work, we propose a novel contact-consistent decoupled diffusion framework CoopDiff, which employs two distinct branches to decouple human and object motion modeling, with the human-object contact points as shared anchors to bridge the motion generation across branches. The human dynamics branch is aimed to predict highly structured human motion, while the object dynamics branch focuses on the object motion with rigid translations and rotations. These two branches are bridged by a series of shared contact points with consistency constraint for coherent human-object motion prediction. To further enhance human-object consistency and prediction reliability, we propose a human-driven interaction module to guide object motion modeling. Extensive experiments on the BEHAVE and Human-object Interaction datasets demonstrate that our CoopDiff outperforms state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。