arXiv:2506.13687stat.APcs.LG2025-06被引 6

改进极端事件预报校准,让模型更可靠预测罕见高风速

Enforcing tail calibration when training probabilistic forecast models

  • 用加权评分函数和尾部偏差正则化改进损失函数
  • 现有先进模型对极端风速预报严重失准,改进后显著提升校准性
  • 适合关注极端风险决策的能源、气象领域研究者

概率预报通常通过优化合适评分准则训练统计或机器学习模型获得。若模型类别设定错误,学习到的模型未必能生成校准的预报。校准预报有助于用户合理权衡决策风险,尤其对极端事件尤为重要,因其常带来重大社会经济影响。本文研究如何通过调整训练损失函数来提升极端事件预报的可靠性。我们考察基于加权评分规则的损失函数,并提出使用尾部校准偏差作为正则项。在英国风速预报任务中,测试了从简单参数模型到分布回归网络及条件生成模型的一系列日益灵活的模型。结果表明,当前最先进的模型对极端风速预报存在严重校准偏差,而通过损失函数的适当调整可有效改善极端事件的校准性能。这引入了极端事件校准与常规事件校准之间的权衡。

原文摘要 · Abstract (English)

Probabilistic forecasts are typically obtained using state-of-the-art statistical and machine learning models, with model parameters estimated by optimizing a proper scoring rule over a set of training data. If the model class is not correctly specified, then the learned model will not necessarily issue forecasts that are calibrated. Calibrated forecasts allow users to appropriately balance risks in decision making, and it is particularly important that forecast models issue calibrated predictions for extreme events, since such outcomes often generate large socio-economic impacts. In this work, we study how the loss function used to train probabilistic forecast models can be adapted to improve the reliability of forecasts made for extreme events. We investigate loss functions based on weighted scoring rules, and additionally propose regularizing loss functions using a measure of tail miscalibration. We apply these approaches to a hierarchy of increasingly flexible forecast models for UK wind speeds, including simple parametric models, distributional regression networks, and conditional generative models. We demonstrate that state-of-the-art models do not issue calibrated forecasts for extreme wind speeds, and that the calibration of forecasts for extreme events can be improved by suitable adaptations to the loss function during model training. This introduces a trade-off between calibrated forecasts for extreme events and calibrated forecasts for more common outcomes.

概率预报校准极端事件风速预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。