提出NAP框架,让神经网络在保持精度的同时大幅压缩参数并可解释。
Neural Feature Governance: Extending Atom Prevalence

- 基于贝叶斯思想,通过四阶段流程自动选择关键神经元节点。
- 在MNIST上将活跃节点压缩至原模型的8%,且不确定性估计准确。
- 适合需要高可靠性、低资源消耗的可信AI场景使用。
神经网络压缩与可解释性仍是现代深度学习中的开放挑战,百亿参数模型虽精度高,但缺乏透明度、计算效率和可靠的不确定性量化。本文提出神经原子流行度(NAP),一种针对前馈神经网络的结构化节点级模型选择的贝叶斯框架。NAP引入神经原子(激活单元),采用四阶段流程:通过迭代幅度剪枝(IMP)识别贝叶斯彩票券(BLT),软变分训练脉冲与滑块独立高斯(SS-IG)模型,利用泊松-二项分布(PB)优化层大小,最后进行贝叶斯微调,生成稀疏、稳定、可解释且精确的模型。在模拟非线性回归、两个UCI基准数据集(Concrete, YearPredictionMSD)及MNIST图像分类任务上的实证验证表明,NAP实现最先进的结构稀疏性,在MNIST上将活跃节点减少至原模型的8%,同时具备良好校准的概率不确定性:所有实验中模型无知仅占总预测方差的3至4%;回归可靠性图显示预测区间覆盖率接近名义水平(实际93.4%,目标95%)。这些结果确立了NAP作为稀疏性、准确性、可解释性和不确定性量化协同优化的可靠、理论严谨且计算可行的解决方案。
原文摘要 · Abstract (English)
Neural network compression and interpretability remain open challenges in modern deep learn- ing, where billion-parameter architectures deliver impressive accuracy at the cost of trans- parency, computational efficiency, and reliable uncertainty quantification. This paper introduces Neural Atom Prevalence (NAP), a principled Bayesian framework for structured node-level model selection in feedforward neural networks. NAP introduces the neural atom (activation unit) and functions as a hybrid method operating through a four-phase pipeline: Bayesian Lottery Ticket (BLT) identification via Iterative Magnitude Pruning (IMP), soft variational training of the Spike and Slab Independent Gaussian (SS-IG) model, Poisson-Binomial (PB) optimal layer-size selection, and Bayesian fine-tuning to produce a sparse, stable, interpretable, and accurate model. Extensive empirical validation across simulated nonlinear regression, two UCI benchmark datasets (Concrete, YearPredictionMSD), and the MNIST image classification task demonstrates that NAP achieves state-of-the-art structural sparsity, reducing active nodes to as few as 8% of the original dense architecture on MNIST, while well-calibrated probabilisti- cally: the aleatoric-epistemic uncertainty decomposition reveals that model ignorance accounts for only 3 to 4% of total predictive variance across all experiments, and regression reliability diagrams confirm a near-nominal predictive interval coverage (93.4% observed against a 95% target). These results establish NAP as a reliable, theoretically grounded, and computation- ally tractable solution to the simultaneous pursuit of sparsity, accuracy, interpretability, and uncertainty quantification in Bayesian neural networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。