arXiv:2506.05059cs.LGstat.ML2025-06被引 1

NIMO让神经网络既可解释又高效,融合线性模型与深度学习优势。

NIMO: a Nonlinear Interpretable MOdel

  • 基于线性回归扩展,用参数消去法优化神经网络与线性系数
  • 在保持高预测性能的同时实现可解释的特征影响分析
  • 适合需要模型透明度的医疗、金融等高风险场景

深度学习在多个领域取得显著成功,但也催生了对模型预测可解释性的日益增长需求。尽管已有诸多可解释机器学习方法,但事后解释缺乏保证的保真度且对超参数敏感,凸显了内在可解释模型的吸引力。例如,线性回归通过系数清晰展示特征影响。然而,这类模型通常被更复杂的神经网络(NNs)超越,而后者往往缺乏内在可解释性。为解决这一困境,我们提出NIMO框架,结合神经网络的表达能力与内在可解释性。在简单线性回归基础上,NIMO能够提供灵活且可理解的特征效应。我们开发了一种基于参数消除的优化方法,可有效高效地优化神经网络参数和线性系数。通过自适应岭回归,可轻松引入稀疏性。实验证明,该模型能在保持良好预测性能的同时,提供忠实且可解释的特征效应。

原文摘要 · Abstract (English)

Deep learning has achieved remarkable success across many domains, but it has also created a growing demand for interpretability in model predictions. Although many explainable machine learning methods have been proposed, post-hoc explanations lack guaranteed fidelity and are sensitive to hyperparameter choices, highlighting the appeal of inherently interpretable models. For example, linear regression provides clear feature effects through its coefficients. However, such models are often outperformed by more complex neural networks (NNs) that usually lack inherent interpretability. To address this dilemma, we introduce NIMO, a framework that combines inherent interpretability with the expressive power of neural networks. Building on the simple linear regression, NIMO is able to provide flexible and intelligible feature effects. Relevantly, we develop an optimization method based on parameter elimination, that allows for optimizing the NN parameters and linear coefficients effectively and efficiently. By relying on adaptive ridge regression we can easily incorporate sparsity as well. We show empirically that our model can provide faithful and intelligible feature effects while maintaining good predictive performance.

可解释模型神经网络线性回归特征分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。