将配对文本视为时间序列的辅助变量,提升多模态预测性能。
Language in the Flow of Time: Time-Series-Paired Texts Weaved into a Unified Temporal Narrative
- 把文本看作时间序列的辅助变量,利用其周期性特征增强模型理解。
- 在多个基准数据集上,显著提升数值+文本时间序列的预测与补全效果。
- 无需修改原有模型结构,可通用接入各类时间序列模型,适合多模态研究者。
尽管时间序列模型大多聚焦于数值数据,但涉及上下文文本信息的多模态时间序列研究仍处于起步阶段。随着大语言模型和时间序列学习的发展,我们重新审视了配对文本与时间序列的融合问题,基于柏拉图表征假说——不同模态的表征会收敛到共享空间。研究发现,时间序列配对的文本天然具有与原始时间序列高度相似的周期特性。基于此,我们提出新框架Texts as Time Series(TaTS),将配对文本视为时间序列的辅助变量。该框架可无缝嵌入任意仅处理数值数据的时间序列模型中,有效实现对带文本的时间序列建模。在多个基准数据集上,使用多种现有时间序列模型进行的大量实验表明,TaTS可在不修改模型架构的前提下,显著提升多模态时间序列预测与缺失值补全性能。代码已公开于https://github.com/iDEA-iSAIL-Lab-UIUC/TaTS。
原文摘要 · Abstract (English)
While many advances in time series models focus exclusively on numerical data, research on multimodal time series, particularly those involving contextual textual information, remains in its infancy. With recent progress in large language models and time series learning, we revisit the integration of paired texts with time series through the Platonic Representation Hypothesis, which posits that representations of different modalities converge to shared spaces. In this context, we identify that time-series-paired texts may naturally exhibit periodic properties that closely mirror those of the original time series. Building on this insight, we propose a novel framework, Texts as Time Series (TaTS), which considers the time-series-paired texts to be auxiliary variables of the time series. TaTS can be plugged into any existing numerical-only time series models and effectively enable them to handle time series data with paired texts. Through extensive experiments on both multimodal time series forecasting and imputation tasks across benchmark datasets with various existing time series models, we demonstrate that TaTS can enhance multimodal predictive performance without modifying model architectures. Our Code is available at https://github.com/iDEA-iSAIL-Lab-UIUC/TaTS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。