arXiv:2510.24601stat.MLcs.LG2025-10综述被引 6

对比统计模型与神经网络在真实数据上的表现,发现二者各有优劣。

Comparison of generalised additive models and neural networks in applications: A systematic review

  • 基于系统综述分析143篇论文的430个数据集,比较GAMs与神经网络性能
  • 在大多数指标上无明显优劣,但神经网络在大数据和高维特征下稍占优势
  • 强调可解释性使GAMs在小数据场景仍具竞争力,适合注重透明性的应用

神经网络已成为预测建模中的流行工具,常与机器学习和人工智能相关联,而广义加性模型(GAMs)是保持可解释性的灵活非线性统计模型。本文遵循PRISMA指南,系统回顾了在真实表格数据上对两类模型进行实证比较的研究。共识别出143篇合格论文,涵盖430个数据集,提取并报告了论文与数据集层面的关键属性。除总结比较结果外,还使用混合效应模型分析报告的性能指标,探究可能解释差异的特征,包括应用领域、研究年份、样本量、预测变量数量及神经网络复杂度。在多数数据集上,未发现GAMs或神经网络在最常报告的指标(RMSE、$R^2$、AUC)上具有持续优势。神经网络在大样本和高维数据中表现更优,但该优势随时间减弱;相反,GAMs在小样本场景中保持竞争力,且具备可解释性。文献中对数据集特征和神经网络复杂度的报告普遍不完整,影响透明度与可复现性。本综述表明,两者应视为互补而非竞争关系,在多数表格数据任务中性能差距有限,可解释性可能使GAMs更具吸引力。

原文摘要 · Abstract (English)

Neural networks have become a popular tool in predictive modelling, more commonly associated with machine learning and artificial intelligence than with statistics. Generalised Additive Models (GAMs) are flexible non-linear statistical models that retain interpretability. Both are state-of-the-art in their own right, with their respective advantages and disadvantages. This paper analyses how these two model classes have performed on real-world tabular data. Following PRISMA guidelines, we conducted a systematic review of papers that performed empirical comparisons of GAMs and neural networks. Eligible papers were identified, yielding 143 papers, with 430 datasets. Key attributes at both paper and dataset levels were extracted and reported. Beyond summarising comparisons, we analyse reported performance metrics using mixed-effects modelling to investigate potential characteristics that can explain and quantify observed differences, including application area, study year, sample size, number of predictors, and neural network complexity. Across datasets, no consistent evidence of superiority was found for either GAMs or neural networks when considering the most frequently reported metrics (RMSE, $R^2$, and AUC). Neural networks tended to outperform in larger datasets and in those with more predictors, but this advantage narrowed over time. Conversely, GAMs remained competitive, particularly in smaller data settings, while retaining interpretability. Reporting of dataset characteristics and neural network complexity was incomplete in much of the literature, limiting transparency and reproducibility. This review highlights that GAMs and neural networks should be viewed as complementary approaches rather than competitors. For many tabular applications, the performance trade-off is modest, and interpretability may favour GAMs.

模型对比可解释性统计学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。