arXiv:2510.20651cs.LG2025-10

通过知识蒸馏与专家融合,提升极端事件预测准确率。

xTime: Extreme Event Prediction with Hierarchical Knowledge Distillation and Expert Fusion

  • 用低频事件模型的知识蒸馏,增强对罕见事件的预测能力。
  • 动态选择并融合多专家模型输出,极端事件预测准确率达78%。
  • 适合气候、医疗等需要精准预警的高风险场景。

极端事件在真实世界的时间序列中频繁发生,如洪水、热浪或急性医疗事件,常带来严重后果。现有时间序列预测模型虽整体性能良好,但对极端事件(如高温或心率骤升)预测效果不佳,主要因数据不平衡,且忽略前序中间事件中的关键信息。本文提出xTime框架,通过知识蒸馏将低频事件模型的知识迁移至稀有事件预测,同时引入混合专家(MoE)机制,动态选择并融合不同稀有度水平的专家模型输出,进一步提升极端事件预测性能。多个数据集上的实验表明,该方法使极端事件预测准确率从3%提升至78%,实现稳定显著改进。

原文摘要 · Abstract (English)

Extreme events frequently occur in real-world time series and often carry significant practical implications. In domains such as climate and healthcare, these events, such as floods, heatwaves, or acute medical episodes, can lead to serious consequences. Accurate forecasting of such events is therefore of substantial importance. Most existing time series forecasting models are optimized for overall performance within the prediction window, but often struggle to accurately predict extreme events, such as high temperatures or heart rate spikes. The main challenges are data imbalance and the neglect of valuable information contained in intermediate events that precede extreme events. In this paper, we propose xTime, a novel framework for extreme event forecasting in time series. xTime leverages knowledge distillation to transfer information from models trained on lower-rarity events, thereby improving prediction performance on rarer ones. In addition, we introduce a mixture of experts (MoE) mechanism that dynamically selects and fuses outputs from expert models across different rarity levels, which further improves the forecasting performance for extreme events. Experiments on multiple datasets show that xTime achieves consistent improvements, with forecasting accuracy on extreme events improving from 3% to 78%.

时间序列极端事件知识蒸馏MoE

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。