用集成方法提升时序大模型的预测稳定性和可靠性
Enhancing Transformer-Based Foundation Models for Time Series Forecasting via Bagging, Boosting and Statistical Ensembles
- 结合自助采样、残差建模和误差反馈,构建混合增强框架
- 在比利时电力负荷数据上,多步预测误差降低显著
- 适合需要高可靠性的工业级时序预测场景
时序基础模型(TSFMs)如Lag-Llama、TimeGPT、Chronos、MOMENT、UniTS和TimesFM在时序预测、异常检测、分类和插补任务中展现出强大的泛化能力和零样本性能。然而,在真实业务数据部署时,其预测仍存在方差大、领域偏倚和不确定性量化不足的问题。本文研究了基于自助采样(bagging)、回归堆叠(stacking)、预测区间构建、统计残差建模和迭代误差反馈等统计与集成方法,以提升模型鲁棒性与准确性。以比利时电力短期负荷预测数据集为案例,结果表明所提混合方法在多个预测时域上均优于单一基础模型。基于回归的集成取得最低均方误差;自助聚合显著降低长上下文预测误差;残差建模有效纠正系统性偏差;生成的预测区间实现接近名义覆盖率,且随着上下文长度增加而变窄。结果表明,将统计推理融入现代基础模型可显著提升真实时序应用中的精度、可靠性和可解释性。
原文摘要 · Abstract (English)
Time series foundation models (TSFMs) such as Lag-Llama, TimeGPT, Chronos, MOMENT, UniTS, and TimesFM have shown strong generalization and zero-shot capabilities for time series forecasting, anomaly detection, classification, and imputation. Despite these advantages, their predictions still suffer from variance, domain-specific bias, and limited uncertainty quantification when deployed on real operational data. This paper investigates a suite of statistical and ensemble-based enhancement techniques, including bootstrap-based bagging, regression-based stacking, prediction interval construction, statistical residual modeling, and iterative error feedback, to improve robustness and accuracy. Using the Belgium Electricity Short-Term Load Forecasting dataset as a case study, we demonstrate that the proposed hybrids consistently outperform standalone foundation models across multiple horizons. Regression-based ensembles achieve the lowest mean squared error; bootstrap aggregation markedly reduces long-context errors; residual modeling corrects systematic bias; and the resulting prediction intervals achieve near nominal coverage with widths shrinking as context length increases. The results indicate that integrating statistical reasoning with modern foundation models yields measurable gains in accuracy, reliability, and interpretability for real-world time series applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。