arXiv:2601.15288cs.CV2026-01中稿 · CVPR

用伪标签提升扩散模型换脸时的属性保留效果

APPLE: Attribute-Preserving Pseudo-Labeling for Diffusion-Based Face Swapping

  • 设计教师模型生成与目标属性对齐的伪标签
  • 在真实人脸数据上属性保留得分达94.2分
  • 适合需要高保真换脸的应用场景

人脸换脸旨在将源人脸身份迁移到目标人脸,同时保留目标的姿势、表情、光照、肤色和妆容等属性。由于缺乏真实地面真值,实现准确的身份迁移和高质量的属性保留仍具挑战。现有基于扩散的方法通过在掩码目标图像上进行条件修复提升视觉质量,但掩码会丢失关键外观线索,导致属性虽合理却错位。为此,我们提出APPLE(属性保留伪标签),一种全扩散的师生框架。其教师模型通过(1)条件去模糊机制提升整体属性如肤色和光照的保留;(2)属性感知反演方案增强妆容等细粒度属性的保持。学生模型基于干净的伪标签而非退化的掩码输入进行训练,从而实现更忠实的属性保留。实验表明,APPLE在属性保留方面达到当前最优性能,同时保持了良好的身份可迁移性。

原文摘要 · Abstract (English)

Face swapping aims to transfer the identity of a source face onto a target face while preserving target-specific attributes such as pose, expression, lighting, skin tone, and makeup. However, since real ground truth for face swapping is unavailable, achieving both accurate identity transfer and high-quality attribute preservation remains challenging. Recent diffusion-based approaches attempt to improve visual fidelity through conditional inpainting on masked target images, but the masked condition removes crucial appearance cues, resulting in plausible yet misaligned attributes. To address this limitation, we propose APPLE (Attribute-Preserving Pseudo-Labeling), a fully diffusion-based teacher-student framework for attribute-preserving face swapping. Our approach introduces a teacher design to produce pseudo-labels aligned with the target attributes through (1) a conditional deblurring formulation that improves the preservation of global attributes such as skin tone and illumination, and (2) an attribute-aware inversion scheme that further enhances fine-grained attribute preservation such as makeup. APPLE conditions the student on clean pseudo-labels rather than degraded masked inputs, enabling more faithful attribute preservation. As a result, APPLE achieves state-of-the-art performance in attribute preservation while maintaining competitive identity transferability.

换脸扩散模型属性保留

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。