用分拆数据训练双模型,保护扩散模型免受隐私泄露攻击
Dual-Model Defense: Safeguarding Diffusion Models from Membership Inference Attacks through Disjoint Data Splitting
- 训练两个独立模型,分别使用原始数据的不重叠子集
- 使成员推理攻击成功率显著下降,生成质量保持良好
- 适合关注隐私安全的图像生成研究者和应用开发者
扩散模型在图像生成中表现出色,但其对成员推理攻击(MIAs)的脆弱性带来严重隐私风险。本文提出两种新方法(DualMD 和 DistillMD),通过在原始数据的不重叠子集上分别训练两个扩散模型来实现高效防御。DualMD 采用私有推理流程,同时利用两个模型,大幅降低单个模型对训练样本的敏感信息泄露。DistillMD 则利用双模型生成“软标签”训练一个私有学生模型,进一步增强对各类 MIAs 的防护能力。在多种数据集上,白盒与黑盒环境下对前沿 MIA 方法的全面评估表明,两种方法均能显著降低攻击成功率,同时保持优异的图像生成性能。实验还发现,DistillMD 不仅防御攻击,还能缓解模型记忆现象,说明两类问题皆源于过拟合,可由统一策略同时解决。
原文摘要 · Abstract (English)
Diffusion models have demonstrated remarkable capabilities in image synthesis, but their recently proven vulnerability to Membership Inference Attacks (MIAs) poses a critical privacy concern. This paper introduces two novel and efficient approaches (DualMD and DistillMD) to protect diffusion models against MIAs while maintaining high utility. Both methods are based on training two separate diffusion models on disjoint subsets of the original dataset. DualMD then employs a private inference pipeline that utilizes both models. This strategy significantly reduces the risk of black-box MIAs by limiting the information any single model contains about individual training samples. The dual models can also generate "soft targets" to train a private student model in DistillMD, enhancing privacy guarantees against all types of MIAs. Extensive evaluations of DualMD and DistillMD against state-of-the-art MIAs across various datasets in white-box and black-box settings demonstrate their effectiveness in substantially reducing MIA success rates while preserving competitive image generation performance. Notably, our experiments reveal that DistillMD not only defends against MIAs but also mitigates model memorization, indicating that both vulnerabilities stem from overfitting and can be addressed simultaneously with our unified approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。