BNN的性能对超参数敏感,需系统分析才能准确量化不确定性。
The Sensitivity of Variational Bayesian Neural Network Performance to Hyperparameters
- 通过全局敏感性分析,揭示超参数对预测精度和不确定性的影响
- 多个超参数相互作用,显著影响模型表现,部分影响难以直观判断
- 建议用敏感性分析或贝叶斯优化来选超参数,提升真实场景可用性
在科学应用中,若缺乏准确的不确定性量化(UQ),预测模型的使用价值有限,无法判断模型是否在外推或需要更多数据。贝叶斯神经网络(BNN)通过传播权重不确定性,有望同时实现精准预测和可靠的UQ。然而,实践中获得准确的UQ仍困难重重,原因包括训练时采用的近似方法以及超参数选择复杂——与传统神经网络相比,BNN的超参数数量更多,且其影响往往不透明。本文通过全局敏感性分析,研究不同超参数设置下BNN性能的变化。结果表明,多个超参数之间存在复杂交互,共同影响预测准确性与不确定性估计。为提升BNN在实际中的可靠性,我们建议采用全局敏感性分析或贝叶斯优化等方法,辅助进行超参数降维与选择,以确保准确的不确定性量化。
原文摘要 · Abstract (English)
In scientific applications, predictive modeling is often of limited use without accurate uncertainty quantification (UQ) to indicate when a model may be extrapolating or when more data needs to be collected. Bayesian Neural Networks (BNNs) produce predictive uncertainty by propagating uncertainty in neural network (NN) weights and offer the promise of obtaining not only an accurate predictive model but also accurate UQ. However, in practice, obtaining accurate UQ with BNNs is difficult due in part to the approximations used for practical model training and in part to the need to choose a suitable set of hyperparameters; these hyperparameters outnumber those needed for traditional NNs and often have opaque effects on the results. We aim to shed light on the effects of hyperparameter choices for BNNs by performing a global sensitivity analysis of BNN performance under varying hyperparameter settings. Our results indicate that many of the hyperparameters interact with each other to affect both predictive accuracy and UQ. For improved usage of BNNs in real-world applications, we suggest that global sensitivity analysis, or related methods such as Bayesian optimization, should be used to aid in dimensionality reduction and selection of hyperparameters to ensure accurate UQ in BNNs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。