arXiv:2412.03104cs.AI2024-12中稿 · VLDB' 25被引 113

用合成数据训练的多模态模型,让大模型能理解时间序列并推理。

ChatTS: Aligning Time Series with LLMs via Synthetic Data for Enhanced Understanding and Reasoning

  • 将时间序列视为图像般模态,用合成数据训练模型理解时序
  • 在6个对齐任务上比GPT-4o高46.0%,在4个推理任务上高25.8%
  • 适合需要分析复杂时序数据的工业、金融等场景

理解时间序列对现实应用至关重要。近期大语言模型(LLMs)被广泛用于时间序列任务,借助其强大语言能力提升应用效果。然而,面向时间序列理解与推理的多模态大模型(MLLMs)研究仍有限,主要受限于高质量图文对齐数据稀缺。本文提出ChatTS,一种新型时间序列-多模态大模型,将时间序列作为与图像类似模态处理,实现对时序数据的理解与推理。为缓解训练数据不足问题,我们提出基于属性的合成时间序列生成方法,结合时间序列演进指令(Time Series Evol-Instruct),生成多样化问答数据以增强推理能力。据我们所知,ChatTS是首个仅基于合成数据微调、接受多变量时间序列输入的时序-多模态大模型。我们在包含六项对齐任务和四项推理任务的真实世界基准数据集上评估性能,结果表明其显著优于现有视觉基多模态模型(如GPT-4o)和文本/代理基大模型,在对齐任务中提升46.0%,在推理任务中提升25.8%。代码、模型检查点及数据集已开源。

原文摘要 · Abstract (English)

Understanding time series is crucial for its application in real-world scenarios. Recently, large language models (LLMs) have been increasingly applied to time series tasks, leveraging their strong language capabilities to enhance various applications. However, research on multimodal LLMs (MLLMs) for time series understanding and reasoning remains limited, primarily due to the scarcity of high-quality datasets that align time series with textual information. This paper introduces ChatTS, a novel MLLM designed for time series analysis. ChatTS treats time series as a modality, similar to how vision MLLMs process images, enabling it to perform both understanding and reasoning with time series. To address the scarcity of training data, we propose an attribute-based method for generating synthetic time series with detailed attribute descriptions. We further introduce Time Series Evol-Instruct, a novel approach that generates diverse time series Q&As, enhancing the model's reasoning capabilities. To the best of our knowledge, ChatTS is the first TS-MLLM that takes multivariate time series as input for understanding and reasoning, which is fine-tuned exclusively on synthetic datasets. We evaluate its performance using benchmark datasets with real-world data, including six alignment tasks and four reasoning tasks. Our results show that ChatTS significantly outperforms existing vision-based MLLMs (e.g., GPT-4o) and text/agent-based LLMs, achieving a 46.0% improvement in alignment tasks and a 25.8% improvement in reasoning tasks. We have open-sourced the source code, model checkpoint and datasets at https://github.com/NetManAIOps/ChatTS.

时间序列多模态合成数据大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。