通过跨图一致性约束,提升个人化图像生成的隐私防护能力
Privacy Protection Against Personalized Text-to-Image Synthesis via Cross-image Consistency Constraints
- 引入跨图一致性约束,利用多图间关系增强隐私保护
- 在CelebHQ和VGGFace2上显著优于现有方法
- 适合关注生成模型隐私安全的研究者与应用开发者
扩散模型与个性化技术的快速发展使得仅凭少量公开图像即可复现个人肖像。尽管这为创作应用带来便利,但也引发严重隐私风险,攻击者可借此生成高度逼真的伪造形象。为此,已有反个性化方法通过向公开图像添加对抗扰动来干扰个性化模型训练。然而,现有方法大多忽视个性化固有的多图特性,采用单图独立扰动策略,未能利用图像间的关联性。为此,我们提出群体级隐私保护视角,引入跨图反个性化(CAP)框架,通过强制扰动图像间风格一致性来增强抗个性化能力,并设计动态比例调整策略,在攻击迭代中自适应平衡一致性损失的影响。在经典的CelebHQ和VGGFace2数据集上的大量实验表明,CAP显著优于现有方法。
原文摘要 · Abstract (English)
The rapid advancement of diffusion models and personalization techniques has made it possible to recreate individual portraits from just a few publicly available images. While such capabilities empower various creative applications, they also introduce serious privacy concerns, as adversaries can exploit them to generate highly realistic impersonations. To counter these threats, anti-personalization methods have been proposed, which add adversarial perturbations to published images to disrupt the training of personalization models. However, existing approaches largely overlook the intrinsic multi-image nature of personalization and instead adopt a naive strategy of applying perturbations independently, as commonly done in single-image settings. This neglects the opportunity to leverage inter-image relationships for stronger privacy protection. Therefore, we advocate for a group-level perspective on privacy protection against personalization. Specifically, we introduce Cross-image Anti-Personalization (CAP), a novel framework that enhances resistance to personalization by enforcing style consistency across perturbed images. Furthermore, we develop a dynamic ratio adjustment strategy that adaptively balances the impact of the consistency loss throughout the attack iterations. Extensive experiments on the classical CelebHQ and VGGFace2 benchmarks show that CAP substantially improves existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。