让时间序列同时看图说话,提升预测准确率
Teaching Time Series to See and Speak: Forecasting with Aligned Visual and Textual Perspectives
- 将数值序列转为视觉与文本双视角,通过对比学习对齐
- 在15个短期和6个长期数据集上超越主流基线模型
- 适合需要理解复杂时序模式的金融、气象等场景
时间序列预测传统上依赖单一数值输入,难以捕捉高层次语义模式。尽管近期研究尝试用大语言模型将时间序列表示为文本,但受限于离散标记序列,且缺乏人类常用的视觉直觉。本文提出一种多模态对比学习框架,将原始时间序列转化为结构化的视觉与文本视角。两个模态均直接从数值序列构建,不依赖自然语言或真实图像。通过对比学习在共享语义空间中对齐双视角,使模型获得更丰富互补的表示。此外,引入可变选择模块,利用对齐表示识别多变量预测中最关键的变量。在15个短期和6个长期预测基准上的大量实验表明,该方法持续优于强大多模态与单模态基线,验证了多模态对齐在时间序列预测中的有效性。代码已开源:https://github.com/Ironieser/TimesCLIP。
原文摘要 · Abstract (English)
Time series forecasting traditionally relies on unimodal numerical inputs, which often struggle to capture high-level semantic patterns due to their dense and unstructured nature. While recent approaches have explored representing time series as text using large language models (LLMs), these methods remain limited by the discrete nature of token sequences and lack the perceptual intuition humans typically apply, such as interpreting visual patterns. In this paper, we propose a multimodal contrastive learning framework that transforms raw time series into structured visual and textual perspectives. Rather than using natural language or real-world images, we construct both modalities directly from numerical sequences. We then align these views in a shared semantic space via contrastive learning, enabling the model to capture richer and more complementary representations. Furthermore, we introduce a variate selection module that leverages the aligned representations to identify the most informative variables for multivariate forecasting. Extensive experiments on fifteen short-term and six long-term forecasting benchmarks demonstrate that our approach consistently outperforms strong unimodal and cross-modal baselines, highlighting the effectiveness of multimodal alignment in enhancing time series forecasting. Code is available at: https://github.com/Ironieser/TimesCLIP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。