arXiv:2605.13678cs.LG2026-05

分三阶段训练让简单模型实现长时序预测新高度

Three-Stage Learning Unlocks Strong Performance in Simple Models for Long-Term Time Series Forecasting

论文配图:Three-Stage Learning Unlocks Strong Performance in Simple Models for Long-Term Time Series Forecasting
图 1 · 摘自论文原文
  • 分阶段训练:共享动态→变量微调→残差融合
  • 9个基准上超越或持平主流模型,保持浅层MLP结构
  • 适合追求简洁高效方案的时序建模研究者

近期研究表明,简单线性模型和基于MLP的预测器可在不依赖复杂架构的情况下实现优异的长时序预测性能。然而,许多先进基线仍依赖频域建模、显式分解或多尺度混合等结构先验,较少关注简单时间映射的训练与组织方式。本文提出STAIR(分阶段时序自适应与个体化残差学习),一种无需引入复杂模块的训练范式,旨在激发简单时间映射模型的潜力。STAIR将预测能力分解为三个渐进阶段:首先通过共享时间映射学习跨变量共性动态;其次通过通道级微调适配各变量特性以捕捉特定模式;最后借助残差学习融入跨变量信息。我们进一步引入共享到个体微调与alpha-RevIN,缓解严格通道独立性及标准RevIN强归一化先验的问题。该设计逐步提升建模灵活性,主实验中核心时间预测器保持为浅层MLP,线性变体亦单独分析。在九个长时序预测基准上的实验表明,STAIR在保持简单骨干结构的同时,性能达到或超过近期强基线,为长时序预测提供了一种简洁高效的建模视角。

原文摘要 · Abstract (English)

Recent studies on long-term time series forecasting have shown that simple linear models and MLP-based predictors can achieve strong performance without increasingly complex architectures. However, many competitive baselines still rely on structural priors such as frequency-domain modeling, explicit decomposition, multi-scale mixing, or sophisticated cross-variable interaction modules, while paying less attention to how simple temporal mappings should be trained and organized. In this paper, we propose STAIR, short for Stagewise Temporal Adaptation via Individualization and Residual Learning, a training paradigm for long-term time series forecasting that aims to unlock the capacity of simple temporal mapping models without introducing complex architectural modules. STAIR decomposes forecasting ability into three progressive stages: it first learns common temporal dynamics across variables through a shared temporal mapping, then adapts the shared model to each variable via channel-wise fine-tuning to capture variable-specific patterns, and finally complements the backbone with cross-variable information through residual learning. We further introduce Shared-to-Individual Fine-tuning and alpha-RevIN to mitigate the limitations of strict channel independence and the overly strong normalization prior induced by standard RevIN. This design gradually increases modeling flexibility while keeping the core temporal predictor as a shallow MLP in the main experiments, with linear variants analyzed separately. Experiments on nine long-term forecasting benchmarks show that STAIR matches or outperforms recent strong baselines while preserving a simple temporal backbone, providing a concise and effective modeling perspective for long-term time series forecasting.

时序预测模型简化分阶段训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。