arXiv:2504.10905cs.CVcs.HC2025-04中稿 · ACMMM 2025被引 5

生成逼真人手与面部交互动作,用于生物识别反欺骗系统

InterAnimate: Taming Region-aware Diffusion Model for Realistic Human Interaction Animation

  • 用区域感知扩散模型学习动态接触与形变规律
  • 在9万条标注视频上实现自然无碰撞的交互动画
  • 适合做生物识别、虚拟人交互等领域的研究者

近期视频生成研究多集中于孤立动作,而手-脸等交互动作仍缺乏系统研究。这类交互对基于运动的生物识别反欺骗系统至关重要。为满足安全需求,亟需大规模高质量交互视频用于训练认证模型。本文提出一种全新手-脸交互动画生成范式,同时学习时空接触动力学与符合生物力学的形变效果,实现手部动作引发真实面部变形且无穿透碰撞。为此构建了包含18种交互模式、9万条标注视频的InterHF数据集。并提出专门针对交互动画的区域感知扩散模型InterAnimate,通过可学习时空隐变量捕捉动态交互先验,并在去噪过程中注入区域感知机制。据我们所知,这是首个系统研究人手-脸交互的大规模工作。定性与定量结果表明,InterAnimate生成动画高度逼真,达到新基准。代码与数据将公开以推动研究。

原文摘要 · Abstract (English)

Recent video generation research has focused heavily on isolated actions, leaving interactive motions-such as hand-face interactions-largely unexamined. These interactions are essential for emerging biometric authentication systems, which rely on interactive motion-based anti-spoofing approaches. From a security perspective, there is a growing need for large-scale, high-quality interactive videos to train and strengthen authentication models. In this work, we introduce a novel paradigm for animating realistic hand-face interactions. Our approach simultaneously learns spatio-temporal contact dynamics and biomechanically plausible deformation effects, enabling natural interactions where hand movements induce anatomically accurate facial deformations while maintaining collision-free contact. To facilitate this research, we present InterHF, a large-scale hand-face interaction dataset featuring 18 interaction patterns and 90,000 annotated videos. Additionally, we propose InterAnimate, a region-aware diffusion model designed specifically for interaction animation. InterAnimate leverages learnable spatial and temporal latents to effectively capture dynamic interaction priors and integrates a region-aware interaction mechanism that injects these priors into the denoising process. To the best of our knowledge, this work represents the first large-scale effort to systematically study human hand-face interactions. Qualitative and quantitative results show InterAnimate produces highly realistic animations, setting a new benchmark. Code and data will be made public to advance research.

交互动画扩散模型生物识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。