arXiv:2502.15215stat.MLcs.LG2025-02ICML被引 5

提出新型神经网络,让可解释模型组件估计更稳定准确。

Tensor Product Neural Networks for Functional ANOVA Model

  • 基于张量积基展开,确保函数分解唯一性。
  • 理论证明能良好逼近任意光滑函数,实测稳定性显著提升。
  • 适合需要稳定可解释性的复杂模型分析场景。

机器学习模型的可解释性日益重要。功能型ANOVA模型通过将高维函数分解为低维函数之和(称为分量),成为可解释人工智能的重要工具。近年来,已有多种神经网络用于估计这些分量,但现有方法在估计时高度不稳定,因为分量本身不唯一——同一函数存在多种可能的ANOVA分解。本文提出一种新型神经网络,名为ANOVA张量积神经网络(ANOVA-TPNN),其设计基于张量积基展开,可保证分解唯一,从而实现各分量的稳定、准确估计。理论上,我们证明了ANOVA-TPNN能够良好逼近任意光滑函数;实验上,无论训练数据或模型参数初始值如何变化,该方法对各分量的估计均比现有神经网络更稳定,因此提供更可靠的解释。

原文摘要 · Abstract (English)

Interpretability for machine learning models is becoming more and more important as machine learning models become more complex. The functional ANOVA model, which decomposes a high-dimensional function into a sum of lower dimensional functions (commonly referred to as components), is one of the most popular tools for interpretable AI, and recently, various neural networks have been developed for estimating each component in the functional ANOVA model. However, such neural networks are highly unstable when estimating each component since the components themselves are not uniquely defined. That is, there are multiple functional ANOVA decompositions for a given function. In this paper, we propose a novel neural network which guarantees a unique functional ANOVA decomposition and thus is able to estimate each component stably and accurately. We call our proposed neural network ANOVA Tensor Product Neural Network (ANOVA-TPNN) since it is motivated by the tensor product basis expansion. Theoretically, we prove that ANOVA-TPNN can approximate any smooth function well. Empirically, we show that ANOVA-TPNN provide much more stable estimation of each component and thus much more stable interpretation when training data and initial values of the model parameters vary than existing neural networks do.

可解释性神经网络函数分解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。