首个从零训练的文本与时间序列联合模型,性能媲美专用模型。
Chronicle: A Multimodal Foundation Model for Joint Language and Time Series Understanding
- 共享同一架构,通过联合预训练自然语言与时间序列数据。
- 在24个时序分类任务上超越现有方法,19项NLU任务持平小模型。
- 适合需要融合文本与时序信息的研究者,如金融预测、健康监测。
真实世界的时间序列常伴随文本信息:元数据、描述、新闻、报告等。然而现有时间序列基础模型仅处理数值序列,而多模态模型通常在预训练语言模型基础上后加适配器,其表征从未接触过时间数据。这些模型也几乎只与其它多模态基线对比,未与各领域最强的单模态基础模型比较,难以判断联合训练是否必要。我们提出Chronicle,一个324M参数的解码器仅结构变压器,从零开始在自然语言与时间序列上联合预训练。两种模态共享相同变压器块、注意力机制和残差流;大部分预训练使用单模态批次,跨模态能力由共享参数自发涌现,仅用短阶段交错输入实现对齐。据我们所知,Chronicle是首个从零联合预训练文本与时间序列的模型,也是首个在两个领域均与专用基础模型对比的多模态模型。它在19项NLU任务上达到Gemma-3-270M-PT水平,在24个UCR/UEA时序分类数据集上创下新纪录,并在Time-MMD上生成的多模态预测优于所有监督融合基线,全部来自单一主干网络。
原文摘要 · Abstract (English)
Real-world time series come with text: metadata, descriptions, news, reports. Yet time series foundation models process numerical sequences in isolation, and the multimodal text-and-time-series models that attempt to bridge the two all adapt a pretrained language model post hoc, inheriting representations shaped without ever seeing temporal data. These models are also evaluated almost exclusively against other multimodal baselines, not against the strongest unimodal foundation models in either domain, leaving open whether joint training is needed at all. We present Chronicle, a compact 324M-parameter decoder-only transformer trained from scratch on natural language and time series within a single unified architecture. Both modalities share the same transformer blocks, attention mechanism, and residual stream; the bulk of pretraining uses unimodal batches so cross-modal capability emerges purely from shared parameters, with a short alignment stage that interleaves the two. To our knowledge, Chronicle is the first model jointly pretrained on text and time series from scratch, and the first multimodal model evaluated against dedicated foundation models in both domains. It matches Gemma-3-270M-PT on 19 NLU tasks, sets a new bar for frozen-embedding time series classification on 24 UCR/UEA datasets, and produces multimodal forecasts on Time-MMD that beat every supervised fusion baseline, all from a single backbone.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。