评估高斯过程机器势的不确定性估计,发现其可靠性有限。
Evaluation of uncertainty estimations for Gaussian process regression based machine learning interatomic potentials
- 用GPR标准差和集成方法评估不确定性
- 高不确定性对应高偏差,但无法量化误差范围
- 适合用于识别高风险预测,不适合直接作为误差置信区间
机器学习原子间势(MLIPs)的不确定性估计对量化模型误差、指导主动学习中的样本选择至关重要。本文评估基于高斯过程回归(GPR)的MLIPs的不确定性估计,包括预测标准差和集成方法估计的不确定性。研究从校准性与主动学习性能两方面展开。采用库仑和光滑原子位置重叠(SOAP)表示输入,预测分子势能面和激发能。结果表明:集成方法的全局校准性较差;而GPR标准差虽具良好全局校准性,但在高不确定性预测中存在系统性偏差,且不确定性与偏差正相关,但无法定量反映误差。因此,该标准差可帮助识别高误差区域,但不能作为误差范围的可靠指标。在固定配置空间中选取标准差最高的样本训练模型,会过度关注数据边界,导致密集区域性能下降,但提升外推任务的泛化能力。
原文摘要 · Abstract (English)
Uncertainty estimations for machine learning interatomic potentials (MLIPs) are crucial for quantifying model error and identifying informative training samples in active learning strategies. In this study, we evaluate uncertainty estimations of Gaussian process regression (GPR)-based MLIPs, including the predictive GPR standard deviation and ensemble-based uncertainties. We do this in terms of calibration and in terms of impact on model performance in an active learning scheme. We consider GPR models with Coulomb and Smooth Overlap of Atomic Positions (SOAP) representations as inputs to predict potential energy surfaces and excitation energies of molecules. Regarding calibration, we find that ensemble-based uncertainty estimations show already poor global calibration (e.g., averaged over the whole test set). In contrast, the GPR standard deviation shows good global calibration, but when grouping predictions by their uncertainty, we observe a systematical bias for predictions with high uncertainty. Although an increasing uncertainty correlates with an increasing bias, the bias is not captured quantitatively by the uncertainty. Therefore, the GPR standard deviation can be useful to identify predictions with a high bias and error but, without further knowledge, should not be interpreted as a quantitative measure for a potential error range. Selecting the samples with the highest GPR standard deviation from a fixed configuration space leads to a model that overemphasizes the borders of the configuration space represented in the fixed dataset. This may result in worse performance in more densely sampled areas but better generalization for extrapolation tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。