arXiv:2409.16426stat.MLcs.LG2024-09

用统计方法解析单层神经网络,提升可解释性与准确性

Statistical tuning of artificial neural network

  • 将神经网络视为非参数回归模型,建立理论基础
  • 提出置信区间和显著性检验,评估输入神经元重要性
  • 在IDC和Iris数据集上验证,适合想理解网络机制的研究者

神经网络因结构复杂、参数众多常被视为“黑箱”,难以解释。本文针对单隐层神经网络,建立理论框架,证明其估计器可被视作非参数回归模型。基于此,提出统计检验方法评估输入神经元的显著性,并引入聚类与主成分分析(PCA)进行降维,简化网络结构,提升可解释性与预测准确率。关键贡献包括:开发了用于评估人工神经网络性能的自助法(bootstrapping),应用统计检验与逻辑回归分析隐藏神经元,评估神经元效率;研究个体隐藏神经元与输出神经元的关系。方法在IDC和Iris数据集上得到验证,展现出良好的实用性。该研究推动了可解释人工智能的发展,为理解输入-输出及网络内部组件间关系提供了稳健的统计工具。

原文摘要 · Abstract (English)

Neural networks are often regarded as "black boxes" due to their complex functions and numerous parameters, which poses significant challenges for interpretability. This study addresses these challenges by introducing methods to enhance the understanding of neural networks, focusing specifically on models with a single hidden layer. We establish a theoretical framework by demonstrating that the neural network estimator can be interpreted as a nonparametric regression model. Building on this foundation, we propose statistical tests to assess the significance of input neurons and introduce algorithms for dimensionality reduction, including clustering and (PCA), to simplify the network and improve its interpretability and accuracy. The key contributions of this study include the development of a bootstrapping technique for evaluating artificial neural network (ANN) performance, applying statistical tests and logistic regression to analyze hidden neurons, and assessing neuron efficiency. We also investigate the behavior of individual hidden neurons in relation to out-put neurons and apply these methodologies to the IDC and Iris datasets to validate their practical utility. This research advances the field of Explainable Artificial Intelligence by presenting robust statistical frameworks for interpreting neural networks, thereby facilitating a clearer understanding of the relationships between inputs, outputs, and individual network components.

可解释AI神经网络统计建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。