arXiv:2510.03519cs.CLcs.AI2025-10中稿 · Transactions on Ma…被引 13

让时间序列模型与大语言模型对齐,实现更智能的时序推理。

TS-Reasoner: Aligning Time Series Foundation Models with LLM Reasoning

  • 通过合成时序-文本对,对齐时序模型与语言模型的隐表示。
  • 在多个基准上超越同类模型,且训练数据少于一半。
  • 适合需要时序理解与复杂推理的应用场景,如金融、能源。

时序推理在金融、能源和科学发现等领域至关重要。现有时序基础模型(TSFMs)虽能捕捉低层动态模式并提供精准预测,但进一步分析通常需额外背景知识与复杂推理能力,这正是多数TSFMs所缺乏的,而大型语言模型(LLMs)可弥补此短板。然而,未经昂贵微调的LLMs在理解时序数值数据方面表现不佳。尽管将两者结合直觉上合理,但如何有效对齐两类模型以完成推理任务仍是开放挑战。为此,我们提出TS-Reasoner,通过将TSFMs的隐表示与LLM的文本输入对齐,用于下游理解/推理任务。具体而言,我们设计了一种简单有效的合成方法,生成多样化的时序-文本配对数据用于对齐训练,并采用两阶段训练策略:先进行对齐预训练,再进行指令微调。不同于以往让LLM直接接收时序数据的方法,我们使用预训练的TSFM并冻结其参数。在多个基准上的实验表明,TS-Reasoner不仅优于众多开源LLM、视觉-语言模型(VLMs)及同规模时序LLMs,且具备显著的数据效率优势,例如仅用不到一半的训练数据即可达到更好性能。

原文摘要 · Abstract (English)

Time series reasoning is crucial to decision-making in diverse domains, including finance, energy, and scientific discovery. While existing time series foundation models (TSFMs) can capture low-level dynamic patterns and provide accurate forecasting, further analysis usually requires additional background knowledge and sophisticated reasoning, which are lacking in most TSFMs but can be achieved through Large Language Models (LLMs). On the other hand, without expensive post-training, LLMs often struggle with the numerical understanding of time series data. Although it is intuitive to integrate the two types of models, developing effective training recipes that align the two modalities for reasoning tasks is still an open challenge. To this end, we propose TS-Reasoner that aligns the latent representations of TSFMs with the textual inputs of LLMs for downstream understanding/reasoning tasks. Specifically, we propose a simple yet effective method to curate diverse, synthetic pairs of time series and textual captions for alignment training. We then develop a two-stage training recipe that applies instruction fine-tuning after the alignment pretraining. Unlike existing works that train an LLM to take time series as inputs, we leverage a pretrained TSFM and freeze it during training. Experiments on several benchmarks demonstrate that TS-Reasoner not only outperforms a wide range of open-source LLMs, Vision-Language Models (VLMs), and Time Series LLMs of comparable scale, but also does so with remarkable data efficiency, e.g., using less than half the training data.

时序推理多模态对齐大模型融合数据效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。