用贝叶斯神经网络增强物理信息机器学习的不确定性量化能力
Exploring Efficient Quantification of Modeling Uncertainties with Differentiable Physics-Informed Machine Learning Architectures
- 将贝叶斯神经网络嵌入可微分的物理信息架构,实现不确定性建模
- 在飞行实验数据上验证,预测性能与纯数据驱动模型相当
- 蒙特卡洛采样法最有效传播不确定性,适合高可靠性工程场景
量化与传播建模不确定性对工程设计与控制中的可靠性分析、鲁棒优化等模型驱动算法至关重要。近年来,物理信息机器学习(PIML)作为传统计算建模与代理建模的替代方案,兼顾计算效率、建模精度与可解释性,但其不确定性预测与传播能力尚未被充分探索。本文将可微分的混合式PIML架构(结合部分物理知识与神经网络)与贝叶斯神经网络(BNN)融合,以评估BNN是否能有效赋予PIML架构不确定性传播能力,并利用架构的可微特性提升训练效率。采用两阶段训练缓解概率机器学习模型的传统训练难题。在解析基准问题及固定翼遥控飞机飞行实验数据上进行评估,结果表明:预测性能略差或与纯数据驱动模型及原始PIML模型相当。此外,对BNN权重进行蒙特卡洛采样被证实是最有效的不确定性传播方法。
原文摘要 · Abstract (English)
Quantifying and propagating modeling uncertainties is crucial for reliability analysis, robust optimization, and other model-based algorithmic processes in engineering design and control. Now, physics-informed machine learning (PIML) methods have emerged in recent years as a new alternative to traditional computational modeling and surrogate modeling methods, offering a balance between computing efficiency, modeling accuracy, and interpretability. However, their ability to predict and propagate modeling uncertainties remains mostly unexplored. In this paper, a promising class of auto-differentiable hybrid PIML architectures that combine partial physics and neural networks or ANNs (for input transformation or adaptive parameter estimation) is integrated with Bayesian Neural networks (replacing the ANNs); this is done with the goal to explore whether BNNs can successfully provision uncertainty propagation capabilities in the PIML architectures as well, further supported by the auto-differentiability of these architectures. A two-stage training process is used to alleviate the challenges traditionally encountered in training probabilistic ML models. The resulting BNN-integrated PIML architecture is evaluated on an analytical benchmark problem and flight experiments data for a fixed-wing RC aircraft, with prediction performance observed to be slightly worse or at par with purely data-driven ML and original PIML models. Moreover, Monte Carlo sampling of probabilistic BNN weights was found to be most effective in propagating uncertainty in the BNN-integrated PIML architectures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。