arXiv:2512.00293cs.LGcs.AI2025-12

用大模型增强时间序列预测,让文本信息更精准辅助时序分析。

FiCoTS: Fine-to-Coarse LLM-Enhanced Hierarchical Cross-Modality Interaction for Time Series Forecasting

  • 采用大模型增强文本理解,分三层次逐步融合时序与文本信息
  • 在7个真实数据集上达到顶尖性能,提升预测准确性
  • 适合关注多模态时序建模与大模型应用的研究者

时间序列预测在数据分析与网络技术中至关重要。大语言模型(LLM)的兴起为该领域带来了新机遇,尤其在跨模态方面。现有方法多采用 LLM 作为预测主干,通过设计模态对齐机制使 LLM 理解时间序列数据,但时序与文本语义差异大,难以充分融合。为此,本文提出一种 LLM-as-Enhancer 范式,仅用 LLM 编码文本以补充时序信息。基于此,我们构建 FiCoTS 框架,通过细粒度到粗粒度的三级交互机制实现跨模态融合:首先,在词元级对齐模块中,构建动态异构图以过滤噪声并对齐时间序列片段与文本词元;其次,在特征级交互模块中,引入全局交叉注意力,使每个时序变量能关联相关文本上下文;最后,在决策级融合模块中,设计门控网络自适应融合双模态结果。三个模块协同作用,实现跨语义层级的全面交互,使文本信息有效支持时序预测。在七个真实世界基准上的实验表明,本模型表现达到当前最优水平。代码将公开发布。

原文摘要 · Abstract (English)

Time series forecasting is central to data analysis and web technologies. The recent success of Large Language Models (LLMs) offers significant potential for this field, especially from the cross-modality aspect. Most methods adopt an LLM-as-Predictor paradigm, using LLM as the forecasting backbone and designing modality alignment mechanisms to enable LLM to understand time series data. However, the semantic information in the two modalities of time series and text differs significantly, making it challenging for LLM to fully understand time series data. To mitigate this challenge, our work follows an LLM-as-Enhancer paradigm to fully utilize the advantage of LLM in text understanding, where LLM is only used to encode text modality to complement time series modality. Based on this paradigm, we propose FiCoTS, an LLM-enhanced fine-to-coarse framework for multimodal time series forecasting. Specifically, the framework facilitates progressive cross-modality interaction by three levels in a fine-to-coarse scheme: First, in the token-level modality alignment module, a dynamic heterogeneous graph is constructed to filter noise and align time series patches with text tokens; Second, in the feature-level modality interaction module, a global cross-attention mechanism is introduced to enable each time series variable to connect with relevant textual contexts; Third, in the decision-level modality fusion module, we design a gated network to adaptively fuse the results of the two modalities for robust predictions. These three modules work synergistically to let the two modalities interact comprehensively across three semantic levels, enabling textual information to effectively support temporal prediction. Extensive experiments on seven real-world benchmarks demonstrate that our model achieves state-of-the-art performance. The codes will be released publicly.

时间序列多模态大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。