轻量模型Alinear突破时间序列预测的规模依赖,用极少参数实现高效精准预测。
Does Scaling Law Apply in Time Series Forecasting?
- 设计动态分解与频率衰减机制,自适应调节不同预测时长的组件权重。
- 在7个数据集上以不足1%参数量超越大模型,短中长期预测均保持高精度。
- 提出参数感知评估指标,推动小模型在资源受限场景下的公平比较。
时间序列预测中模型规模快速膨胀已成为关键挑战。从早期几十兆字节的Transformer到如今数千兆字节的TimesNet,性能提升常伴随参数量指数级增长。但这种扩展是否必要?为此,我们提出Alinear——一种超轻量预测模型,仅使用k-level参数即达到竞争性表现。引入时序感知自适应分解机制,动态调整不同预测长度下的成分侧重;结合渐进式频率衰减策略,在不引入注意力计算开销的前提下实现多时距稳定预测。在7个基准数据集上的大量实验表明,Alinear始终优于大规模模型,参数用量不足其1%,且在短时与超长时预测中均保持强准确性。此外,为更公平评估模型效率,我们提出参数感知评价指标,凸显ALinear在有限模型预算下的优势。分析显示,趋势与季节成分的重要性取决于数据特征而非固定模式,验证了自适应设计的必要性。本工作挑战了‘越大越好’的普遍认知,倡导向更高效的时间序列建模范式转变。
原文摘要 · Abstract (English)
Rapid expansion of model size has emerged as a key challenge in time series forecasting. From early Transformer with tens of megabytes to recent architectures like TimesNet with thousands of megabytes, performance gains have often come at the cost of exponentially increasing parameter counts. But is this scaling truly necessary? To question the applicability of the scaling law in time series forecasting, we propose Alinear, an ultra-lightweight forecasting model that achieves competitive performance using only k-level parameters. We introduce a horizon-aware adaptive decomposition mechanism that dynamically rebalances component emphasis across different forecast lengths, alongside a progressive frequency attenuation strategy that achieves stable prediction in various forecasting horizons without incurring the computational overhead of attention mechanisms. Extensive experiments on seven benchmark datasets demonstrate that Alinear consistently outperforms large-scale models while using less than 1% of their parameters, maintaining strong accuracy across both short and ultra-long forecasting horizons. Moreover, to more fairly evaluate model efficiency, we propose a new parameter-aware evaluation metric that highlights the superiority of ALinear under constrained model budgets. Our analysis reveals that the relative importance of trend and seasonal components varies depending on data characteristics rather than following a fixed pattern, validating the necessity of our adaptive design. This work challenges the prevailing belief that larger models are inherently better and suggests a paradigm shift toward more efficient time series modeling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。