arXiv:2409.07025cs.LG2024-09ICLR被引 2

通过修改采样过程,防止扩散模型复制训练数据且保持图像质量。

CPSample: Classifier Protected Sampling for Guarding Training Data During Diffusion

  • 用随机标签训练分类器,引导生成避开高置信度点。
  • 在CIFAR-10和CelebA-64上分别达到FID 4.97和2.97,无数据复现。
  • 无需重训练模型,可防御成员推理攻击,适合隐私敏感场景。

扩散模型在小数据集上训练时容易精确复现训练数据。现有方法多依赖差分隐私或掩码部分数据,导致图像质量显著下降。本文提出CPSample,通过修改采样过程,在不降低图像质量的前提下防止训练数据复现。该方法训练一个对随机二值标签过拟合的分类器,利用分类器引导生成过程远离高置信度点(包含训练数据)。在CIFAR-10和CelebA-64上,CPSample分别实现FID 4.97和2.97,且未产生训练数据的精确复制品。相比需重训练扩散模型的方法,CPSample仅需训练分类器,计算成本更低。此外,该方法增强了模型对成员推理攻击的鲁棒性,能有效防范攻击者判断哪些图像曾用于训练。实验表明其行为类似内置拒绝采样器,并可防止Stable Diffusion中的模式坍缩。

原文摘要 · Abstract (English)

Diffusion models have a tendency to exactly replicate their training data, especially when trained on small datasets. Most prior work has sought to mitigate this problem by imposing differential privacy constraints or masking parts of the training data, resulting in a notable substantial decrease in image quality. We present CPSample, a method that modifies the sampling process to prevent training data replication while preserving image quality. CPSample utilizes a classifier that is trained to overfit on random binary labels attached to the training data. CPSample then uses classifier guidance to steer the generation process away from the set of points that can be classified with high certainty, a set that includes the training data. CPSample achieves FID scores of 4.97 and 2.97 on CIFAR-10 and CelebA-64, respectively, without producing exact replicates of the training data. Unlike prior methods intended to guard the training images, CPSample only requires training a classifier rather than retraining a diffusion model, which is computationally cheaper. Moreover, our technique provides diffusion models with greater robustness against membership inference attacks, wherein an adversary attempts to discern which images were in the model's training dataset. We show that CPSample behaves like a built-in rejection sampler, and we demonstrate its capabilities to prevent mode collapse in Stable Diffusion.

扩散模型数据隐私成员推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。