让人脸生成模型忘记特定人物,保护隐私。
PIU: Proximity-guided Identity Unlearning in ID-Conditioned Diffusion Models

- 用锚点引导替换身份嵌入,实现精准删除
- 仅微调少量注意力层,即可有效抑制目标身份生成
- 适合需隐私保护的生成模型应用
身份条件扩散模型能生成高质量且身份一致的人脸图像,但可能在个体要求被遗忘后仍继续生成其形象,引发严重隐私问题。尽管机器遗忘在概念和数据删除方面已有研究,但在直接以身份嵌入为条件的模型中,身份遗忘仍基本未被探索。本文针对Arc2Face这一先进的人脸生成潜空间扩散模型,提出近邻引导的身份遗忘框架PIU。该方法将身份移除建模为身份替换任务,将源身份重新分配至学习空间中选定的锚点身份,并采用基于弧面表示几何结构的近邻锚点选择策略。进一步表明,通过局部微调少量身份敏感的交叉注意力层,即可实现有效遗忘。在多个目标身份上的实验表明,该框架能有效抑制目标身份生成,同时保持保留身份的真实感与身份一致性,经由遗忘性能与图像质量指标提升及定性评估验证。代码已公开于https://github.com/edgarcancinoe/piu-unlearning。
原文摘要 · Abstract (English)
Identity-conditioned diffusion models enable high-quality and identity-consistent face generation, but they also raise severe privacy concerns, as models may continue to synthesize individuals despite their right to be forgotten. While machine unlearning has been extensively studied for concept and data removal, identity unlearning remains largely unexplored, particularly in models conditioned directly on identity embeddings rather than text prompts. In this work, we study identity unlearning in Arc2Face, a state-of-the-art identity-conditioned latent diffusion model for face generation, and introduce Proximity-guided Identity Unlearning (PIU), an anchor-guided framework for identity unlearning. Specifically, we formulate identity removal as an identity replacement objective that reassigns the source identity to a selected anchor identity in the learned identity space, and we complement it with a proximity-based anchor selection strategy motivated by the geometry of ArcFace representations. We further show that effective unlearning can be achieved through localized fine-tuning of a small subset of identity-sensitive cross-attention layers. Experiments across multiple target identities show that our framework effectively suppresses generation of the target identity while preserving realism and identity consistency for retained identities, as validated by improved performance on unlearning and image-quality metrics, together with qualitative evaluation. The source code for the PIU identity unlearning framework is made publicly available at https://github.com/edgarcancinoe/piu-unlearning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。