arXiv:2508.05089cs.LGcs.AI2025-08

提出新方法提升数据影响力分析可靠性,兼顾整体与基准对比。

Integrated Influence: Data Attribution with Baseline

  • 通过数据退化过程逐步逼近基准集,累积样本影响力
  • 在标注错误样本识别任务中表现优于现有方法
  • 支持反事实解释,适合需要透明性分析的场景

数据归属是量化训练样本对测试样本影响的重要手段,有助于理解数据与模型关系,提升机器学习透明度。现有基于留一法(LOO)的方法仅扰动单个训练样本,忽略训练集的整体协同影响,且多数缺乏基准对比,难以提供反事实解释。本文提出集成影响(Integrated Influence)方法,引入基准数据集,通过数据退化过程将当前数据集逐步过渡至基准集,并在整个过程中累积每个样本的影响力。我们建立了坚实的理论框架,证明如影响函数等主流方法可视为本方法的特例。实验表明,集成影响在数据归属任务和标注错误样本识别任务中均比现有方法更可靠。

原文摘要 · Abstract (English)

As an effective approach to quantify how training samples influence test sample, data attribution is crucial for understanding data and model and further enhance the transparency of machine learning models. We find that prevailing data attribution methods based on leave-one-out (LOO) strategy suffer from the local-based explanation, as these LOO-based methods only perturb a single training sample, and overlook the collective influence in the training set. On the other hand, the lack of baseline in many data attribution methods reduces the flexibility of the explanation, e.g., failing to provide counterfactual explanations. In this paper, we propose Integrated Influence, a novel data attribution method that incorporates a baseline approach. Our method defines a baseline dataset, follows a data degeneration process to transition the current dataset to the baseline, and accumulates the influence of each sample throughout this process. We provide a solid theoretical framework for our method, and further demonstrate that popular methods, such as influence functions, can be viewed as special cases of our approach. Experimental results show that Integrated Influence generates more reliable data attributions compared to existing methods in both data attribution task and mislablled example identification task.

数据归属模型透明反事实解释

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。