arXiv:2506.11849cs.LGcs.AI2025-06NeurIPS被引 19

用回归调整提升蒙特卡洛估计,显著降低特征重要性计算误差

Regression-adjusted Monte Carlo Estimators for Shapley Values and Probabilistic Values

  • 结合蒙特卡洛采样与任意可高效计算的概率值函数进行回归调整
  • 对Shapley值误差降低6.5倍,对一般概率值误差降低215倍
  • 适合需要高精度解释的机器学习应用,如数据估值与特征归因

源自博弈论的各类概率值(如Shapley值、Banzhaf值、半值)已成为可解释AI的核心工具,广泛应用于特征归因、数据归因和数据估值等任务。由于这些值的精确计算需指数时间,研究重点转向高效的近似方法,主要依赖蒙特卡洛采样和线性回归两种技术。本文提出一种新方法,将两者有机结合,允许用任意能高效计算概率值的函数族替代线性回归,从而利用树模型(如XGBoost)的高精度优势,同时保持无偏估计。在八个数据集上的实验表明,该方法在估计概率值方面达到当前最优性能:对于Shapley值,误差比Permutation SHAP低6.5倍,比Kernel SHAP低3.8倍,比Leverage SHAP低2.6倍;对于更一般的概率值,误差比先前最优方法低215倍。

原文摘要 · Abstract (English)

With origins in game theory, probabilistic values like Shapley values, Banzhaf values, and semi-values have emerged as a central tool in explainable AI. They are used for feature attribution, data attribution, data valuation, and more. Since all of these values require exponential time to compute exactly, research has focused on efficient approximation methods using two techniques: Monte Carlo sampling and linear regression formulations. In this work, we present a new way of combining both of these techniques. Our approach is more flexible than prior algorithms, allowing for linear regression to be replaced with any function family whose probabilistic values can be computed efficiently. This allows us to harness the accuracy of tree-based models like XGBoost, while still producing unbiased estimates. From experiments across eight datasets, we find that our methods give state-of-the-art performance for estimating probabilistic values. For Shapley values, the error of our methods can be $6.5\times$ lower than Permutation SHAP (the most popular Monte Carlo method), $3.8\times$ lower than Kernel SHAP (the most popular linear regression method), and $2.6\times$ lower than Leverage SHAP (the prior state-of-the-art Shapley value estimator). For more general probabilistic values, we can obtain error $215\times$ lower than the best estimator from prior work.

可解释AIShapley值蒙特卡洛回归调整

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。