用多层级文本对齐提升时间序列预测的准确与可解释性
Enhancing Time Series Forecasting via Multi-Level Text Alignment with LLMs
- 将时间序列分解为趋势、季节和残差,分别生成对应文本表示
- 通过多层级对齐机制,使组件嵌入与预训练词元匹配,提升可解释性
- 在多个数据集上超越现有模型,适合需理解预测逻辑的研究者
将大语言模型(LLMs)应用于时间序列预测面临独特挑战:时间序列连续而LLM处理离散标记。尽管LLMs在自然语言处理及其他结构化领域表现优异,如何在保持预测精度和可解释性的前提下,将时间序列数据与基于语言的表示对齐仍是一大难题。现有方法尝试将时间序列重编程为文本形式,但往往难以产生有意义且可解释的结果。本文提出一种基于多层级文本对齐的时间序列预测框架,不仅提升了预测准确性,还增强了时间序列表示的可解释性。该方法将时间序列分解为趋势、季节和残差成分,并将其重编程为特定组件的文本表示。引入多层级对齐机制,使各组件嵌入与预训练词元对齐,从而实现更清晰的预测解释。在多个数据集上的实验表明,该方法在准确率上优于现有最优模型,同时提供良好的可解释性。
原文摘要 · Abstract (English)
The adaptation of large language models (LLMs) to time series forecasting poses unique challenges, as time series data is continuous in nature, while LLMs operate on discrete tokens. Despite the success of LLMs in natural language processing (NLP) and other structured domains, aligning time series data with language-based representations while maintaining both predictive accuracy and interpretability remains a significant hurdle. Existing methods have attempted to reprogram time series data into text-based forms, but these often fall short in delivering meaningful, interpretable results. In this paper, we propose a multi-level text alignment framework for time series forecasting using LLMs that not only improves prediction accuracy but also enhances the interpretability of time series representations. Our method decomposes time series into trend, seasonal, and residual components, which are then reprogrammed into component-specific text representations. We introduce a multi-level alignment mechanism, where component-specific embeddings are aligned with pre-trained word tokens, enabling more interpretable forecasts. Experiments on multiple datasets demonstrate that our method outperforms state-of-the-art models in accuracy while providing good interpretability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。