用扩散模型实现可控局部人脸匿名,保持图像可用性
Controllable Localized Face Anonymization Via Diffusion Inpainting
- 通过梯度修正控制生成人脸属性,实现精准匿名
- 在CelebA-HQ和FFHQ上优于现有方法,无需额外训练
- 支持指定区域保留原样,适合隐私保护场景
随人像图像在计算机视觉中广泛应用,保护个人身份的需求日益迫切。同时,匿名化图像仍需满足下游任务需求。本文提出统一框架,利用潜在扩散模型的修复能力生成真实感匿名图像。与以往方法不同,我们通过自适应属性引导模块,在反向去噪过程中施加梯度修正,使生成图像的面部属性与目标图像一致,实现完全可控的匿名化。该框架支持局部匿名,用户可指定哪些面部区域保持不变。在公开数据集CelebA-HQ和FFHQ上的大量实验表明,本方法优于当前最优方案,且无需额外模型训练。源代码已公开。
原文摘要 · Abstract (English)
The growing use of portrait images in computer vision highlights the need to protect personal identities. At the same time, anonymized images must remain useful for downstream computer vision tasks. In this work, we propose a unified framework that leverages the inpainting ability of latent diffusion models to generate realistic anonymized images. Unlike prior approaches, we have complete control over the anonymization process by designing an adaptive attribute-guidance module that applies gradient correction during the reverse denoising process, aligning the facial attributes of the generated image with those of the synthesized target image. Our framework also supports localized anonymization, allowing users to specify which facial regions are left unchanged. Extensive experiments conducted on the public CelebA-HQ and FFHQ datasets show that our method outperforms state-of-the-art approaches while requiring no additional model training. The source code is available on our page.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。