对比两种不确定性量化方法,提升汽车碰撞仿真代理模型的可信度。
Uncertainty Quantification for AI-Driven Crash Simulation Surrogates: A Comparative Study of Monte Carlo Dropout and Deep Ensemble on Open-Source Bumper Beam Benchmark
- 用可学习的丢弃率替代固定参数,实现无超参的蒙特卡洛丢弃
- 在相同测试集上,深度集成精度更高但计算成本是其数倍
- 开源流程中实现高校准度不确定性估计,适合工程安全决策
机器学习代理模型正被广泛用于工程产品开发,以补充计算成本高昂的高保真仿真,提供近乎即时的预测。然而,一个关键障碍限制了其在安全敏感流程中的应用:仅给出点预测而无不确定性估计,无法告知工程师何时应信任模型。本文系统地比较了两种常用的不确定性量化方法——蒙特卡洛丢弃与深度集成,应用于基于NVIDIA PhysicsNeMo构建的开源代理管道。核心贡献在于使用混凝土丢弃(concrete dropout),该功能由PhysicsNeMo内置,可在训练过程中端到端学习丢弃率,消除了蒙特卡洛丢弃中需手动调节的丢弃率超参数,直接回应了该方法最常见的批评。以钢制保险杠碰撞问题作为基准,评估了两种方法在相同保留模拟数据上的表现,对比了点预测精度、不确定性带校准度及计算成本。结果揭示出精度与校准之间存在根本权衡,挑战了深度集成是代理模型不确定性量化的默认金标准这一常见假设。研究证明,在完全开源的工程工作流中,可实现高度校准且无需调参的不确定性估计,计算成本仅为集成方法的几分之一。
原文摘要 · Abstract (English)
Machine learning surrogate models are increasingly being explored in engineering product development to augment simulation-driven design, offering near-instantaneous predictions that complement computationally expensive high-fidelity analyses. However, a critical gap limits their adoption in safety-critical workflows: a point prediction without an accompanying uncertainty estimate cannot tell an engineer when the model should not be trusted. This work presents a systematic, head-to-head comparison of two widely used uncertainty quantification approaches -- Monte Carlo Dropout and Deep Ensembles -- applied to an open-source surrogate pipeline built on NVIDIA PhysicsNeMo. A key contribution is the use of concrete dropout, a built-in PhysicsNeMo capability that eliminates the dropout rate as a manual hyperparameter by learning it end-to-end during training, directly addressing the most common criticism of Monte Carlo Dropout-based uncertainty quantification. Automotive crash simulation is used as the application domain, with a steel bumper beam impact problem serving as the benchmark. Both methods are evaluated on identical held-out simulations and compared on point accuracy, uncertainty band calibration, and computational cost. The results reveal a fundamental trade-off between accuracy and calibration that challenges the common assumption that deep ensembles are the default gold standard for surrogate uncertainty quantification. The findings demonstrate that well-calibrated, hyperparameter-free uncertainty estimates are achievable within a fully open-source engineering workflow at a fraction of the computational cost of ensemble approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。