arXiv:2506.05281cs.LGcs.AI2025-06被引 5

提出快速数据价值评估方法,训练一次即可实时计算数据贡献值。

Fast-DataShapley: Neural Modeling for Training Data Valuation

  • 用加权最小二乘建模数据价值,训练一次可重复使用。
  • 相比基线性能提升超2倍,训练速度加快100倍。
  • 适合需要公平分配数据贡献的AI平台与版权保护场景。

训练数据的价值与版权在人工智能产业中至关重要。服务平台应保护数据提供者的合法权益,并公平奖励其贡献。Shapley值是理论上最优越的贡献评估工具,但其计算复杂度随数据提供者数量呈指数增长。现有基于Shapley值的方法虽通过近似算法降低计算开销,但需为每个测试样本重新训练,成本过高。本文提出Fast-DataShapley,一种单次训练方法,利用Shapley值的加权最小二乘表征,训练一个可复用的解释器模型,实现测试样本的实时推理。无需重新训练即可计算训练数据的Shapley值。此外,我们提出三种具有理论保证的方法,从两方面降低训练开销:近似计算效用函数和分组处理训练数据。通过时间复杂度分析验证方法效率。在多个图像数据集上的实验表明,该方法在性能上优于基线超过2倍,解释器训练速度提升两个数量级。

原文摘要 · Abstract (English)

The value and copyright of training data are crucial in the artificial intelligence industry. Service platforms should protect data providers' legitimate rights and fairly reward them for their contributions. Shapley value, a potent tool for evaluating contributions, outperforms other methods in theory, but its computational overhead escalates exponentially with the number of data providers. Recent works based on Shapley values attempt to mitigate computation complexity by approximation algorithms. However, they need to retrain for each test sample, leading to intolerable costs. We propose Fast-DataShapley, a one-pass training method that leverages the weighted least squares characterization of the Shapley value to train a reusable explainer model with real-time reasoning speed. Given new test samples, no retraining is required to calculate the Shapley values of the training data. Additionally, we propose three methods with theoretical guarantees to reduce training overhead from two aspects: the approximate calculation of the utility function and the group calculation of the training data. We analyze time complexity to show the efficiency of our methods. The experimental evaluations on various image datasets demonstrate superior performance and efficiency compared to baselines. Specifically, the performance is improved to more than 2 times, and the explainer's training speed can be increased by two orders of magnitude.

数据价值Shapley值高效计算模型解释

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。