arXiv:2510.21599cs.LGcs.CC2025-10NeurIPS被引 9

提出可高效计算张量网络的可解释性,为神经网络等模型提供精确解释新路径。

SHAP Meets Tensor Networks: Provably Tractable Explanations with Parallelism

  • 基于张量网络结构设计了通用精确的SHAP计算框架。
  • 张量列车结构下可实现对数时间并行计算,效率显著提升。
  • 揭示宽度是模型可解释性计算的主要瓶颈,适合关注解释效率的研究者。

尽管对于决策树等简单模型,沙普利值解释(SHAP)可在多项式时间内计算,但对于更复杂的黑箱模型如神经网络,其计算却变得NP难,而解释需求恰恰在此类模型中最迫切。本文研究张量网络(TNs)的SHAP解释计算问题,提出了适用于任意结构张量网络的通用精确计算框架。有趣的是,当张量网络受限于张量列车(TT)结构时,可通过并行计算在多项式对数时间内完成计算。由于TT的强大表达能力,该复杂度结果可推广至决策树、树集成、线性模型和线性RNN等多种主流模型,从而改进了这些模型以往的复杂度上限。进一步地,通过将二值化神经网络映射为张量网络表示,我们证明:当网络宽度固定时,其SHAP计算可高效可行;而即使深度恒定,计算仍保持困难。这一发现表明,对于此类模型,宽度而非深度是影响可解释性计算的核心瓶颈。

原文摘要 · Abstract (English)

Although Shapley additive explanations (SHAP) can be computed in polynomial time for simple models like decision trees, they unfortunately become NP-hard to compute for more expressive black-box models like neural networks - where generating explanations is often most critical. In this work, we analyze the problem of computing SHAP explanations for *Tensor Networks (TNs)*, a broader and more expressive class of models than those for which current exact SHAP algorithms are known to hold, and which is widely used for neural network abstraction and compression. First, we introduce a general framework for computing provably exact SHAP explanations for general TNs with arbitrary structures. Interestingly, we show that, when TNs are restricted to a *Tensor Train (TT)* structure, SHAP computation can be performed in *poly-logarithmic* time using *parallel* computation. Thanks to the expressiveness power of TTs, this complexity result can be generalized to many other popular ML models such as decision trees, tree ensembles, linear models, and linear RNNs, therefore tightening previously reported complexity results for these families of models. Finally, by leveraging reductions of binarized neural networks to Tensor Network representations, we demonstrate that SHAP computation can become *efficiently tractable* when the network's *width* is fixed, while it remains computationally hard even with constant *depth*. This highlights an important insight: for this class of models, width - rather than depth - emerges as the primary computational bottleneck in SHAP computation.

张量网络可解释性并行计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。