用合成数据让大模型指导时间序列预测,提升准确率超25%
ChronoSteer: Bridging Large Language Model and Time Series Foundation Model via Synthetic Data
- 大模型生成文本指令,引导时间序列模型输出
- 仅用合成数据训练,预测准确率提升25.7%
- 专为多模态时序预测设计,适合需要文本驱动的场景
传统预测方法依赖单一时间序列数据,难以利用丰富的文本信息。近年来,大语言模型(LLMs)和时间序列基础模型(TSFMs)分别在文本推理和时序建模上展现出强大能力。如何融合两者优势,构建能同时利用时序与文本信息进行未来推断的多模态模型,成为关键挑战。为解决事件-序列配对数据稀缺问题,本文提出解耦框架:利用LLM将文本事件转换为修订指令,进而引导TSFM输出。为此构建ChronoSteer,一种可通过文本修订指令调控的多模态TSFM。为缓解跨模态指令-序列配对数据不足,采用基于合成数据的两阶段训练策略。此外,还构建高质量多模态时间序列预测基准,以应对评估中的信息泄露问题。整合LLM后,仅用合成数据训练的ChronoSteer,在预测准确率上相比单模态基线提升25.7%,较此前最优多模态方法提高22.5%。
原文摘要 · Abstract (English)
Conventional forecasting methods rely on unimodal time series data, limiting their ability to exploit rich textual information. Recently, large language models (LLMs) and time series foundation models (TSFMs) have demonstrated powerful capability in textual reasoning and temporal modeling, respectively. Integrating the strengths of both to construct a multimodal model that concurrently leverages both temporal and textual information for future inference has emerged as a critical research challenge. To address the scarcity of event-series paired data, we propose a decoupled framework: an LLM is employed to transform textual events into revision instructions, which are then used to steer the output of TSFM. To implement this framework, we introduce ChronoSteer, a multimodal TSFM that can be steered through textual revision instructions, effectively bridging LLM and TSFM. Moreover, to mitigate the shortage of cross-modal instruction-series paired data, we devise a two-stage training strategy based on synthetic data. In addition, we also construct a high-quality multimodal time series forecasting benchmark to address the information leakage concerns during evaluation. After integrating with an LLM, ChronoSteer, which is trained exclusively on synthetic data, achieves a 25.7% improvement in prediction accuracy compared to the unimodal backbone and a 22.5% gain over the previous state-of-the-art multimodal method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。