arXiv:2511.01307cs.CVcs.AI2025-11NeurIPS被引 1

通过改造模型而非图像,实现对特定主体的隐私保护。

Perturb a Model, Not an Image: Towards Robust Privacy Protection via Anti-Personalized Diffusion Models

  • 直接在扩散模型上施加扰动,阻止个性化训练
  • 新损失函数使生成质量不下降,仍能有效防个性化
  • 适合需要防止身份滥用的AI生成内容场景

近期扩散模型可高质量合成特定主体(如人物或物体),但此能力也带来隐私风险,因个性化技术可能被恶意用户用于生成未经授权的内容。现有方法通过生成对抗性扰动样本干扰个性化,但依赖不切实际假设,在存在少量干净图像或简单图像变换时即失效。为此,本文将保护目标从图像转向扩散模型本身,提出抗个性化扩散模型(APDM)框架。理论分析表明,现有损失函数无法保证鲁棒抗个性化收敛。据此,我们设计了直接防护优化(DPO)损失函数,有效破坏目标模型中的个性化能力,同时保持生成质量。进一步提出双路径优化策略(学习保护,L2P),通过交替执行个性化与防护步骤,模拟未来个性化路径并动态强化防护。实验表明,本方法显著优于现有方案,在防止未经授权个性化方面达到当前最优性能。代码已开源:https://github.com/KU-VGI/APDM。

原文摘要 · Abstract (English)

Recent advances in diffusion models have enabled high-quality synthesis of specific subjects, such as identities or objects. This capability, while unlocking new possibilities in content creation, also introduces significant privacy risks, as personalization techniques can be misused by malicious users to generate unauthorized content. Although several studies have attempted to counter this by generating adversarially perturbed samples designed to disrupt personalization, they rely on unrealistic assumptions and become ineffective in the presence of even a few clean images or under simple image transformations. To address these challenges, we shift the protection target from the images to the diffusion model itself to hinder the personalization of specific subjects, through our novel framework called Anti-Personalized Diffusion Models (APDM). We first provide a theoretical analysis demonstrating that a naive approach of existing loss functions to diffusion models is inherently incapable of ensuring convergence for robust anti-personalization. Motivated by this finding, we introduce Direct Protective Optimization (DPO), a novel loss function that effectively disrupts subject personalization in the target model without compromising generative quality. Moreover, we propose a new dual-path optimization strategy, coined Learning to Protect (L2P). By alternating between personalization and protection paths, L2P simulates future personalization trajectories and adaptively reinforces protection at each step. Experimental results demonstrate that our framework outperforms existing methods, achieving state-of-the-art performance in preventing unauthorized personalization. The code is available at https://github.com/KU-VGI/APDM.

扩散模型隐私保护个性化防御

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。