arXiv:2604.08438cs.LG2026-04被引 1

提出高效计算贡献度的新算法,显著降低计算成本。

Adalina: Adaptive Linear Approximation for the Shapley Value and Beyond

  • 基于向量浓度不等式构建理论框架,优化查询次数
  • 仅需 $O(n/ε^2 \log(1/δ))$ 次查询即达高精度
  • 首个自适应线性时空复杂度算法,适合大规模场景

Shapley值及其广义半值在各类归因问题中备受关注,但其高效近似始终是长期挑战——精确计算通常需要随参与者数 $n$ 指数增长的效用查询。为应对大规模应用需求,本文研究在 $Θ(n)$ 空间约束下近似半值的极限。基于向量浓度不等式,建立理论框架,使现有无偏随机算法的查询复杂度更优。在此框架内,系统设计了一种线性空间算法,仅需 $O(n/ε^2 \log(1/δ))$ 次效用查询,即可保证对所有常见半值满足 $P(\|\hat{\boldsymbol{ϕ}}-\boldsymbol{ϕ}\|_2 \geq ε) \leq δ$。该框架自然统一了OFA、无偏核SHAP、SHAP-IQ与回归调整方法,并明确刻画了配对采样的收益条件。此外,算法可针对特定效用函数显式最小化均方误差 $\mathbb{E}[\|\hat{\boldsymbol{ϕ}}-\boldsymbol{ϕ}\|_2^2]$。因此,提出首个自适应、线性时间、线性空间的随机算法 Adalina,理论上实现更低均方误差。所有理论结果均经实验验证,代码已开源。

原文摘要 · Abstract (English)

The Shapley value, and its broader family of semi-values, has received much attention in various attribution problems. A fundamental and long-standing challenge is their efficient approximation, since exact computation generally requires an exponential number of utility queries in the number of players $n$. To meet the challenges of large-scale applications, we explore the limits of efficiently approximating semi-values under a $Θ(n)$ space constraint. Building upon a vector concentration inequality, we establish a theoretical framework that enables sharper query complexities for existing unbiased randomized algorithms. Within this framework, we systematically develop a linear-space algorithm that requires $O(\frac{n}{ε^{2}}\log\frac{1}δ)$ utility queries to ensure $P(\|\hat{\boldsymbolϕ}-\boldsymbolϕ\|_{2}\geqε)\leq δ$ for all commonly used semi-values. In particular, our framework naturally bridges OFA, unbiased kernelSHAP, SHAP-IQ and the regression-adjusted approach, and definitively characterizes when paired sampling is beneficial. Moreover, our algorithm allows explicit minimization of the mean squared error $\mathbb{E}[\|\hat{\boldsymbolϕ}-\boldsymbolϕ\|_{2}^{2}]$ for each specific utility function. Accordingly, we introduce the first adaptive, linear-time, linear-space randomized algorithm, Adalina, that theoretically achieves improved mean squared error. All of our theoretical findings are experimentally validated. Our code is available at https://github.com/watml/adalina.

归因分析算法优化线性复杂度机器学习解释

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。