arXiv:2604.21289cs.CV2026-04

融合生成对抗网络与扩散模型,实现更精准的面部属性编辑。

AttDiff-GAN: A Hybrid Diffusion-GAN Framework for Facial Attribute Editing

论文配图:AttDiff-GAN: A Hybrid Diffusion-GAN Framework for Facial Attribute Editing
图 1 · 摘自论文原文
  • 分步处理:先用对抗学习精确修改属性,再用扩散模型生成高清图像
  • 在CelebA-HQ上实现更准确的属性编辑,非目标属性保留更好
  • 引入面部先验和注意力机制,提升风格与属性对齐精度

面部属性编辑旨在修改特定属性的同时保持无关内容和整体图像质量。现有基于GAN的方法虽具良好可控性,但风格码与属性语义对齐较弱;基于扩散的方法能生成高保真图像,但不同属性间语义方向纠缠导致编辑精度受限。本文提出AttDiff-GAN,一种结合GAN属性操作与扩散图像生成的混合框架。核心挑战在于一步对抗学习与多步扩散去噪之间的不一致性。为此,我们通过特征级对抗学习解耦属性编辑与图像合成,利用已编辑特征引导扩散生成,并摒弃依赖语义方向的编辑方式。同时引入PriorMapper融入面部先验以增强风格生成,以及RefineExtractor通过Transformer捕捉全局语义关系,实现更精确风格提取。在CelebA-HQ上的实验表明,该方法在定性与定量评估中均优于当前最优方法,实现了更精准的面部属性编辑及非目标属性的更好保留。

原文摘要 · Abstract (English)

Facial attribute editing aims to modify target attributes while preserving attribute-irrelevant content and overall image fidelity. Existing GAN-based methods provide favorable controllability, but often suffer from weak alignment between style codes and attribute semantics. Diffusion-based methods can synthesize highly realistic images; however, their editing precision is limited by the entanglement of semantic directions among different attributes. In this paper, we propose AttDiff-GAN, a hybrid framework that combines GAN-based attribute manipulation with diffusion-based image generation. A key challenge in such integration lies in the inconsistency between one-step adversarial learning and multi-step diffusion denoising, which makes effective optimization difficult. To address this issue, we decouple attribute editing from image synthesis by introducing a feature-level adversarial learning scheme to learn explicit attribute manipulation, and then using the manipulated features to guide the diffusion process for image generation, while also removing the reliance on semantic direction-based editing. Moreover, we enhance style-attribute alignment by introducing PriorMapper, which incorporates facial priors into style generation, and RefineExtractor, which captures global semantic relationships through a Transformer for more precise style extraction. Experimental results on CelebA-HQ show that the proposed method achieves more accurate facial attribute editing and better preservation of non-target attributes than state-of-the-art methods in both qualitative and quantitative evaluations.

面部编辑生成模型扩散模型GAN

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。