为扩散模型提供可扩展的数据归因方法,精准识别关键训练数据。
Influence Functions for Scalable Data Attribution in Diffusion Models
- 基于影响函数框架,用代理指标预测删除数据对生成的影响。
- 提出专用于扩散模型的K-FAC近似,使海森计算高效可扩展。
- 在多个评估上优于现有方法,无需调参,适合模型可解释性研究者。
扩散模型在生成建模中取得显著进展,但其广泛应用带来了数据归因与可解释性挑战。本文提出一种基于影响函数的数据归因框架,通过代理测量预测移除特定训练数据对生成结果概率的影响。我们推导了适用于此类量度的影响函数形式,并将已有方法统一为该框架下的具体设计选择。为提升海森计算的可扩展性,系统性地构建了针对扩散模型的广义高斯-牛顿矩阵的K-FAC近似。实验表明,所提方法在常见评估指标如线性数据建模得分(LDS)及移除高影响数据后的重训练任务中,均优于现有方法,且无需进行方法特异的超参数调优。
原文摘要 · Abstract (English)
Diffusion models have led to significant advancements in generative modelling. Yet their widespread adoption poses challenges regarding data attribution and interpretability. In this paper, we aim to help address such challenges in diffusion models by developing an influence functions framework. Influence function-based data attribution methods approximate how a model's output would have changed if some training data were removed. In supervised learning, this is usually used for predicting how the loss on a particular example would change. For diffusion models, we focus on predicting the change in the probability of generating a particular example via several proxy measurements. We show how to formulate influence functions for such quantities and how previously proposed methods can be interpreted as particular design choices in our framework. To ensure scalability of the Hessian computations in influence functions, we systematically develop K-FAC approximations based on generalised Gauss-Newton matrices specifically tailored to diffusion models. We recast previously proposed methods as specific design choices in our framework and show that our recommended method outperforms previous data attribution approaches on common evaluations, such as the Linear Data-modelling Score (LDS) or retraining without top influences, without the need for method-specific hyperparameter tuning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。