用元学习重加权+微调,提升极端事件预测准确率
ReFine: Boosting Time Series Prediction of Extreme Events by Reweighting and Fine-tuning
- 用元学习动态优化损失权重,让模型更关注极端样本
- 在多个数据集上显著提升极端事件预测性能,最高增益达18.7%
- 方法通用,可适配任意时间序列神经网络模型
极端事件至关重要,如风暴、洪水、极端高温或寒潮等,但因其稀少且分布异常,预测困难。以往研究将其归因于分布外(OOD)问题。本文提出两种策略:重加权与微调。重加权通过带权重的损失函数,对极端样本错误施加更大惩罚,采用元学习动态优化权重,优于传统启发式方法;随后在重加权模型基础上,仅用罕见极端样本进行微调,进一步提升性能。在多个数据集上的实验表明,该方法有效,且具有模型无关性,适用于各类时间序列预测模型。代码已开源。
原文摘要 · Abstract (English)
Extreme events are of great importance since they often represent impactive occurrences. For instance, in terms of climate and weather, extreme events might be major storms, floods, extreme heat or cold waves, and more. However, they are often located at the tail of the data distribution. Consequently, accurately predicting these extreme events is challenging due to their rarity and irregularity. Prior studies have also referred to this as the out-of-distribution (OOD) problem, which occurs when the distribution of the test data is substantially different from that used for training. In this work, we propose two strategies, reweighting and fine-tuning, to tackle the challenge. Reweighting is a strategy used to force machine learning models to focus on extreme events, which is achieved by a weighted loss function that assigns greater penalties to the prediction errors for the extreme samples relative to those on the remainder of the data. Unlike previous intuitive reweighting methods based on simple heuristics of data distribution, we employ meta-learning to dynamically optimize these penalty weights. To further boost the performance on extreme samples, we start from the reweighted models and fine-tune them using only rare extreme samples. Through extensive experiments on multiple data sets, we empirically validate that our meta-learning-based reweighting outperforms existing heuristic ones, and the fine-tuning strategy can further increase the model performance. More importantly, these two strategies are model-agnostic, which can be implemented on any type of neural network for time series forecasting. The open-sourced code is available at \url{https://github.com/JimengShi/ReFine}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。