提出训练阶段解耦身份与非身份特征的图像匿名化方法
Beyond Inference Intervention: Identity-Decoupled Diffusion for Face Anonymization
- 训练时通过掩码学习和双向对齐,显式分离身份与非身份特征
- 推理时仅需替换身份向量,即可实现高质量匿名化且不损失属性信息
- 采用正交映射策略进一步抑制身份泄露,适合隐私保护场景
人脸匿名化旨在隐藏身份信息的同时保留非身份属性。主流扩散模型依赖训练后推断阶段的干预(如负向引导或能量优化),这些方法常引入分布偏移,并将身份与非身份特征纠缠,导致视觉质量下降和数据效用降低。为此,我们提出ID²Face——一种以训练为中心的匿名化框架,无需推断阶段优化。其核心思想是在结构化潜在空间中显式解耦身份与非身份信息,从而在推断时可直接、可控地完成匿名化。具体而言,设计了条件扩散模型,采用身份掩码学习机制:通过身份变分自编码器建模身份特征,从同身份样本对中提取非身份属性并进行双向潜在对齐;再由身份引导的潜在调和器,基于噪声特征预测的软门控融合两者表示。模型使用基于重构的损失函数强制解耦。推断时,仅需从学习到的身份空间中采样随机身份向量即可实现匿名化。为进一步抑制身份泄露,引入正交身份映射策略,强制采样身份与源身份向量正交。实验表明,ID²Face在视觉质量、身份抑制和属性保留方面均优于现有方法。
原文摘要 · Abstract (English)
Face anonymization aims to conceal identity information while preserving non-identity attributes. Mainstream diffusion models rely on inference-time interventions such as negative guidance or energy-based optimization, which are applied post-training to suppress identity features. These interventions often introduce distribution shifts and entangle identity with non-identity attributes, degrading visual fidelity and data utility. To address this, we propose \textbf{ID\textsuperscript{2}Face}, a training-centric anonymization framework that removes the need for inference-time optimization. The rationale of our method is to learn a structured latent space where identity and non-identity information are explicitly disentangled, enabling direct and controllable anonymization at inference. To this end, we design a conditional diffusion model with an identity-masked learning scheme. An Identity-Decoupled Latent Recomposer uses an Identity Variational Autoencoder to model identity features, while non-identity attributes are extracted from same-identity pairs and aligned through bidirectional latent alignment. An Identity-Guided Latent Harmonizer then fuses these representations via soft-gating conditioned on noisy feature prediction. The model is trained with a recomposition-based reconstruction loss to enforce disentanglement. At inference, anonymization is achieved by sampling a random identity vector from the learned identity space. To further suppress identity leakage, we introduce an Orthogonal Identity Mapping strategy that enforces orthogonality between sampled and source identity vectors. Experiments demonstrate that ID\textsuperscript{2}Face outperforms existing methods in visual quality, identity suppression, and utility preservation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。