arXiv:2607.11281cs.CV2026-07中稿 · ACM MM 2026被引 1

解决发型迁移中的身份与几何泄漏问题,实现高保真发型移植。

The Devil Is in the Leakage: A Disentangled Dual-Purification Framework for High-Fidelity Hairstyle Transfer

论文配图:The Devil Is in the Leakage: A Disentangled Dual-Purification Framework for High-Fidelity Hairstyle Transfer
图 1 · 摘自论文原文
  • 双净化框架分离发型与身份信息,抑制生成过程中的泄露。
  • 在多个基准上达到当前最优,显著提升发型保真度与身份一致性。
  • 适合需要精细局部编辑的图像生成研究者与应用开发者。

发型迁移旨在将参考图像的发型移植到源人物身上,同时保持源身份的完整性。尽管基础模型具备强大的生成能力,但在零样本解耦方面表现不佳,常导致参考发型与其原始身份或姿态混淆。现有基于扩散的流程通常先从源图像生成‘光头’图像,再注入参考发型特征。然而,我们发现该范式存在根本性泄漏问题:身份泄漏指发型特征仍携带参考身份或姿态信息;缺陷泄漏指光头图像中的残余伪影会传递至最终合成结果。为此,我们提出双净化框架(DPF),引入两个互补的训练时正则化器。对抗性发型净化(AHP)通过受互信息启发的对抗目标,抑制发型特征的身份可预测性;对比性几何净化(CGP)采用对比目标,规范ControlNet路径,降低模型对光头条件下几何伪影的依赖。通过联合净化发型表示与几何路径,DPF实现了高保真、身份保留的发型迁移,在多种基准上达到最先进性能。

原文摘要 · Abstract (English)

Hairstyle transfer aims to synthesize a photorealistic portrait by transplanting the hairstyle from a reference image onto a source subject while preserving the source identity. Recent foundation models show strong generative capability, but they struggle with the zero-shot disentanglement required for precise local editing, often entangling the reference hairstyle with its original identity and pose. Existing diffusion-based pipelines typically decompose the task by first generating a "bald" image from the source and then injecting hairstyle features from the reference. However, we show that this paradigm suffers from a fundamental leakage problem. Identity Leakage in Hairstyle occurs when hairstyle features retain reference identity or pose information, while Flaw Leakage in Bald arises when residual artifacts in the bald image are propagated into the final synthesis. To address both issues, we propose the Dual-Purification Framework (DPF), which introduces two complementary training-time regularizers. Adversarial Hairstyle Purification (AHP) purifies hairstyle features by suppressing identity predictability under a mutual-information-inspired adversarial objective. Contrastive Geometric Purification (CGP) regularizes the ControlNet pathway with a contrastive objective, reducing the model's reliance on geometric artifacts in the bald condition. By jointly purifying the hairstyle representation and geometric pathway, DPF achieves high-fidelity, identity-preserving hairstyle transfer and state-of-the-art performance on diverse benchmarks.

发型迁移扩散模型图像生成解耦学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。