arXiv:2503.06602cs.LG2025-03中稿 · ICASSP 2024被引 4

提出快速计算加权谢尔普利值的方法,提升机器学习公平赋权效率。

FW-Shapley: Real-time Estimation of Weighted Shapley Values

  • 基于加权最小二乘法构建新表征,设计可学习的估算框架。
  • 特征归因任务上性能优于FastSHAP 27%,数据估值快14倍。
  • 无需真实值训练,理论有效,适合高维场景的公平性分析。

公平的贡献分配在多种机器学习应用中至关重要,谢尔普利值已成为重要工具。然而,在数据估值与特征归因等关键任务中,传统谢尔普利值对不同子集规模采用统一权重,导致赋权结果不直观。为此,加权谢尔普利值被提出,允许为不同规模子集设置不同权重。尽管优势明显,其计算复杂度仍呈指数级增长,难以应用于高维数据。本文提出两项核心贡献:首先,建立加权谢尔普利值的加权最小二乘表征;其次,基于该表征,提出快速加权谢尔普利(FW-Shapley)框架,通过学习的估计器实现高效计算。我们证明该估计器的训练过程理论上成立,即使训练时不使用真实加权谢尔普利值。在特征归因任务中,平均比学习型估计器FastSHAP的包含AUC提升27%;在数据估值任务中,速度比当前最优的KNN Shapley快14倍,且性能相当。

原文摘要 · Abstract (English)

Fair credit assignment is essential in various machine learning (ML) applications, and Shapley values have emerged as a valuable tool for this purpose. However, in critical ML applications such as data valuation and feature attribution, the uniform weighting of Shapley values across subset cardinalities leads to unintuitive credit assignments. To address this, weighted Shapley values were proposed as a generalization, allowing different weights for subsets with different cardinalities. Despite their advantages, similar to Shapley values, Weighted Shapley values suffer from exponential compute costs, making them impractical for high-dimensional datasets. To tackle this issue, we present two key contributions. Firstly, we provide a weighted least squares characterization of weighted Shapley values. Next, using this characterization, we propose Fast Weighted Shapley (FW-Shapley), an amortized framework for efficiently computing weighted Shapley values using a learned estimator. We further show that our estimator's training procedure is theoretically valid even though we do not use ground truth Weighted Shapley values during training. On the feature attribution task, we outperform the learned estimator FastSHAP by $27\%$ (on average) in terms of Inclusion AUC. For data valuation, we are much faster (14 times) while being comparable to the state-of-the-art KNN Shapley.

公平性特征归因加权赋权高效计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。