arXiv:2605.12550cs.CVcs.AI2026-05

用双路适配提升视觉模型预测时间序列的性能

SSDA: Bridging Spectral and Structural Gaps via Dual Adaptation for Vision-Based Time Series Forecasting

论文配图:SSDA: Bridging Spectral and Structural Gaps via Dual Adaptation for Vision-Based Time Series Forecasting
图 1 · 摘自论文原文
  • 通过频谱与结构双重适配,解决图像化时间序列的偏差问题
  • 在7个真实数据集上,全量与少样本场景均优于现有方法
  • 适合想用大视觉模型做时间序列预测的研究者和工程师

大型视觉模型(LVMs)近期被发现能有效进行时间序列预测,仅需将时序数据转为图像即可。然而,这一成功依赖于一个未被充分检验的前提:生成的时间序列图像与自然图像足够相似,使预训练模型的知识可迁移。我们指出仍存在两大差距:频谱差距与结构差距,从根本上限制了LVM在时序预测中的潜力。频谱上,生成图像的功率谱明显更浅;结构上,将一维时序重塑为二维网格会引入虚假空间邻接,同时破坏真实时间连续性,误导预训练模型的空间归纳偏置。为此,我们提出SSDA,一种双分支网络,从数据和模型两层面实现频谱与结构适应。数据层采用2D FFT的频谱幅度对齐器(SMA),选择性增强幅度谱以逼近自然图像统计特性,保留相位信息;模型层采用结构引导的低秩适配(SG-LoRA),向图像块嵌入注入位置感知的时间编码,并通过低秩更新调整注意力。两分支自适应融合生成最终预测。在七个真实世界基准上的大量实验表明,SSDA在全量与少样本设置下均持续优于强基线。代码已公开于https://anonymous.4open.science/r/SSDA-8C5B。

原文摘要 · Abstract (English)

Large vision models (LVMs) have recently proven to be surprisingly effective time series forecasters, simply by rendering temporal data as images. This success, how ever, rests on a largely unexamined premise: the rendered time series images are sufficiently close to natural images for knowledge in pre-trained models to transfer effectively. We argue that two gaps still remain, i.e., spectral and structural gaps, fundamentally limiting the potential of LVMs for time series forecasting. Spectrally, we systematically reveal that rendered time series images exhibit a markedly shallower power spectrum than the natural images LVMs are pre-trained to recognize. Structurally, reshaping 1D temporal sequences into 2D grids fabricates spurious spatial adjacencies while severing genuine temporal continuities, misleading the spatial inductive biases of pre-trained LVMs. To bridge these gaps, we propose SSDA, a dual-branch network that spectrally and structurally adapts to unlock the full potential of LVMs for time series forecasting. At the data level, a Spectral Magnitude Aligner (SMA) applies 2D FFT to selectively enhance the magnitude spectrum toward natural-image statistics while preserving phase. At the model level, a Structural-Guided Low-Rank Adaptation (SG-LoRA) injects position-aware temporal encodings into patch embeddings and adapts at tention via low-rank updates. The two branches are further adaptively fused to produce the final forecast. Extensive experiments on seven real-world benchmarks demonstrate that SSDA consistently outperforms strong LVM- and LLM-based baselines under both full-shot and few-shot settings. Code is publicly available at https://anonymous.4open.science/r/SSDA-8C5B.

时间序列视觉模型频谱适配结构优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。