arXiv:2509.23597cs.LGcs.AI2025-09中稿 · ICLR

通过特征根分析揭示线性时间序列模型的动态规律,提出新正则化方法提升预测鲁棒性。

Characteristic Root Analysis and Regularization for Linear Time Series Forecasting

  • 从特征根出发,理论分析线性模型长期行为与设计选择的关系。
  • 发现噪声导致虚假根出现,需海量数据才能抑制,凸显正则化必要性。
  • 提出降秩与根净化两种新方法,显著提升模型性能与可解释性。

时间序列预测在众多领域仍具挑战性,复杂模型的表现常因数据集而异。近期研究显示简单线性模型表现竟相当竞争力,提示其鲁棒性与可解释性值得深入理论探讨。本文系统研究线性模型在时间序列预测中的作用,聚焦特征根对时序动态的影响。首先在无噪声环境下分析,表明特征根决定长期行为,并解释实例归一化与通道独立性等设计对模型能力的影响。随后拓展至含噪声情形,揭示模型易产生虚假根。由此识别出关键数据缩放特性:抑制噪声影响需远超常规的训练数据量,凸显结构正则化的必要性。为此提出两种互补策略实现稳健的根重构:一是利用降秩技术(如降低秩回归RRR和直接权重降秩DWRR)恢复低维潜在动态;二是提出新颖自适应方法根净化(Root Purge),在训练中引导模型学习噪声抑制的零空间。在标准基准上的大量实验验证了两种方法的有效性,支持理论洞察,并在多个场景达到最先进结果。研究强调将经典线性系统理论与现代学习方法融合,可构建更鲁棒、可解释且数据高效的预测模型。代码公开于:https://github.com/Wangzzzzzzzz/RootPurge。

原文摘要 · Abstract (English)

Time series forecasting remains a critical challenge across numerous domains, yet the effectiveness of complex models often varies unpredictably across datasets. Recent studies highlight the surprising competitiveness of simple linear models, suggesting that their robustness and interpretability warrant deeper theoretical investigation. This paper presents a systematic study of linear models for time series forecasting, with a focus on the role of characteristic roots in temporal dynamics. We begin by analyzing the noise-free setting, where we show that characteristic roots govern long-term behavior and explain how design choices such as instance normalization and channel independence affect model capabilities. We then extend our analysis to the noisy regime, revealing that models tend to produce spurious roots. This leads to the identification of a key data-scaling property: mitigating the influence of noise requires disproportionately large training data, highlighting the need for structural regularization. To address these challenges, we propose two complementary strategies for robust root restructuring. The first uses rank reduction techniques, including \textbf{Reduced-Rank Regression (RRR)} and \textbf{Direct Weight Rank Reduction (DWRR)}, to recover the low-dimensional latent dynamics. The second, a novel adaptive method called \textbf{Root Purge}, encourages the model to learn a noise-suppressing null space during training. Extensive experiments on standard benchmarks demonstrate the effectiveness of both approaches, validating our theoretical insights and achieving state-of-the-art results in several settings. Our findings underscore the potential of integrating classical theories for linear systems with modern learning techniques to build robust, interpretable, and data-efficient forecasting models. The code is publicly available at: https://github.com/Wangzzzzzzzz/RootPurge.

时间序列线性模型特征根正则化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。