arXiv:2507.02691cs.CV2025-07ICCV被引 22

通过解耦表情与身份,实现高保真且动态一致的视频换脸。

CanonSwap: High-Fidelity and Consistent Video Face Swapping via Canonical Space Modulation

  • 在统一的规范空间中分离身份与动作信息,再融合回原视频。
  • 换脸后保持目标面部姿态、表情和口型同步,视觉质量显著提升。
  • 适合需要真实感换脸的应用,如影视制作或虚拟角色替换。

视频换脸旨在实现源身份的高质量迁移并准确保留目标人脸的动态属性,如头部姿态、面部表情和唇形同步。现有方法虽注重身份迁移质量,但常因人脸外观与运动固有耦合导致动态属性失真。为此,本文提出CanonSwap框架,通过解耦运动与外观信息:先消除运动成分,在统一规范空间中修改身份;再将换脸特征重构回原始视频空间,以保留目标动态属性。为实现精准、低伪影的身份迁移,设计了部分身份调制模块,利用空间掩码自适应地仅在面部区域融合源身份特征。此外,引入多项细粒度同步评估指标,全面衡量换脸性能。大量实验表明,本方法在视觉质量、时间一致性与身份保留方面均显著优于现有方法。

原文摘要 · Abstract (English)

Video face swapping aims to address two primary challenges: effectively transferring the source identity to the target video and accurately preserving the dynamic attributes of the target face, such as head poses, facial expressions, lip-sync, \etc. Existing methods mainly focus on achieving high-quality identity transfer but often fall short in maintaining the dynamic attributes of the target face, leading to inconsistent results. We attribute this issue to the inherent coupling of facial appearance and motion in videos. To address this, we propose CanonSwap, a novel video face-swapping framework that decouples motion information from appearance information. Specifically, CanonSwap first eliminates motion-related information, enabling identity modification within a unified canonical space. Subsequently, the swapped feature is reintegrated into the original video space, ensuring the preservation of the target face's dynamic attributes. To further achieve precise identity transfer with minimal artifacts and enhanced realism, we design a Partial Identity Modulation module that adaptively integrates source identity features using a spatial mask to restrict modifications to facial regions. Additionally, we introduce several fine-grained synchronization metrics to comprehensively evaluate the performance of video face swapping methods. Extensive experiments demonstrate that our method significantly outperforms existing approaches in terms of visual quality, temporal consistency, and identity preservation. Our project page are publicly available at https://luoxyhappy.github.io/CanonSwap/.

视频换脸身份解耦动态一致

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。