提出新方法评估扩散模型中训练数据的重要程度,解决版权与隐私风险。
Diffusion Attribution Score: Evaluating Training Data Influence in Diffusion Models
- 基于预测分布的直接对比,设计扩散归因分数DAS
- 在多个数据集和模型上显著优于现有基准
- 适用于大模型,可加速计算,适合关注数据安全的研究者
随着扩散模型日益普及,版权和私密图像的滥用问题愈发突出。一种有前景的解决方案是识别特定训练样本在生成模型中的贡献,即数据归因。现有扩散模型的数据归因方法通常通过增删样本后扩散损失的变化来量化贡献,但这类方法依赖于预测分布与真实分布之间的差异度量,导致对模型行为差异的间接比较,无法准确反映实际影响。为此,本文提出扩散归因分数(Diffusion Attribution Score, DAS),通过直接比较预测分布来衡量训练样本的重要性。理论分析证明了DAS的有效性,并探索了加速计算策略,使其适用于大规模扩散模型。大量实验表明,DAS在线性数据建模得分上显著超越以往基准,达到新的领先水平。
原文摘要 · Abstract (English)
As diffusion models become increasingly popular, the misuse of copyrighted and private images has emerged as a major concern. One promising solution to mitigate this issue is identifying the contribution of specific training samples in generative models, a process known as data attribution. Existing data attribution methods for diffusion models typically quantify the contribution of a training sample by evaluating the change in diffusion loss when the sample is included or excluded from the training process. However, we argue that the direct usage of diffusion loss cannot represent such a contribution accurately due to the calculation of diffusion loss. Specifically, these approaches measure the divergence between predicted and ground truth distributions, which leads to an indirect comparison between the predicted distributions and cannot represent the variances between model behaviors. To address these issues, we aim to measure the direct comparison between predicted distributions with an attribution score to analyse the training sample importance, which is achieved by Diffusion Attribution Score (\textit{DAS}). Underpinned by rigorous theoretical analysis, we elucidate the effectiveness of DAS. Additionally, we explore strategies to accelerate DAS calculations, facilitating its application to large-scale diffusion models. Our extensive experiments across various datasets and diffusion models demonstrate that DAS significantly surpasses previous benchmarks in terms of the linear data-modelling score, establishing new state-of-the-art performance. Code is available at \hyperlink{here}{https://github.com/Jinxu-Lin/DAS}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。