用扩散模型实现无需训练的面部隐私破解,成功率超90%。
DiffMI: Breaking Face Recognition Privacy via Diffusion-Driven Training-Free Model Inversion
- 基于扩散模型构建无训练逆向攻击流程
- 对未见身份攻击成功率达84.42%~92.87%
- 适合研究隐私安全与对抗攻击的学者
人脸识别因依赖敏感且不可更改的生物特征数据而存在严重隐私风险。尽管现代系统通过将人脸图像映射为嵌入(常被视为隐私保护)来缓解风险,但模型逆向攻击表明身份信息仍可被恢复,暴露关键漏洞。现有攻击通常计算成本高且泛化能力差,尤其是需针对目标进行训练的方法。即使无训练方法也受限于身份控制能力,难以还原细微或未见身份。本文提出DiffMI,首个基于扩散模型的无训练逆向攻击方法。DiffMI引入新颖流程,结合鲁棒的潜在码初始化、排序对抗精炼策略及统计基础的置信度感知优化目标。该方法可直接应用于未见身份和人脸识别模型,适应性优于依赖训练的方法,同时显著降低计算开销。在抗逆向系统上攻击成功率达84.42%~92.87%,优于最优先前无训练生成对抗网络方法4.01%~9.82%。代码已开源:https://github.com/azrealwang/DiffMI。
原文摘要 · Abstract (English)
Face recognition poses serious privacy risks due to its reliance on sensitive and immutable biometric data. While modern systems mitigate privacy risks by mapping facial images to embeddings (commonly regarded as privacy-preserving), model inversion attacks reveal that identity information can still be recovered, exposing critical vulnerabilities. However, existing attacks are often computationally expensive and lack generalization, especially those requiring target-specific training. Even training-free approaches suffer from limited identity controllability, hindering faithful reconstruction of nuanced or unseen identities. In this work, we propose DiffMI, the first diffusion-driven, training-free model inversion attack. DiffMI introduces a novel pipeline combining robust latent code initialization, a ranked adversarial refinement strategy, and a statistically grounded, confidence-aware optimization objective. DiffMI applies directly to unseen target identities and face recognition models, offering greater adaptability than training-dependent approaches while significantly reducing computational overhead. Our method achieves 84.42%--92.87% attack success rates against inversion-resilient systems and outperforms the best prior training-free GAN-based approach by 4.01%--9.82%. The implementation is available at https://github.com/azrealwang/DiffMI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。