arXiv:2603.01042cs.CLcs.AI2026-03被引 2

让大模型学会理解时间序列数据,提升决策能力。

Thoth: Mid-Training Bridges LLMs to Time Series Understanding

  • 通过中段训练对齐时序与自然语言,构建专用语料库Book-of-Thoth
  • 在多个时序问答任务上超越基线模型和先进大模型
  • 尤其在数据稀缺时仍表现优异,适合需要时序推理的场景

大型语言模型(LLM)在通用推理中表现出色,但在理解时序数据方面仍存在困难,限制了其在依赖时间动态的决策场景中的应用。本文提出Thoth,首个具备通用时序理解能力的中段训练大模型家族。作为关键中间阶段,中段训练实现了时序与自然语言之间任务和领域无关的对齐,为此构建了高质量、以时序为中心的中段训练语料库Book-of-Thoth。Book-of-Thoth支持时序到文本和文本到时序的生成,使模型掌握基础时序模式。为进一步评估高级推理能力,我们提出了KnoTS,一个专注于知识密集型时序理解的新基准,用于联合推理时序模式与领域知识。大量实验表明,使用Book-of-Thoth进行中段训练的Thoth,在多个时序问答基准上显著优于其基线模型和先进的LLMs。此外,当在数据稀缺条件下微调时,Thoth仍展现出优越性能,验证了中段训练在时序理解中的有效性。代码已开源:https://github.com/thuml/Thoth。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have demonstrated remarkable success in general-purpose reasoning. However, they still struggle to understand and reason about time series data, which limits their effectiveness in decision-making scenarios that depend on temporal dynamics. In this paper, we propose Thoth, the first family of mid-trained LLMs with general-purpose time series understanding capabilities. As a pivotal intermediate stage, mid-training achieves task- and domain-agnostic alignment between time series and natural language, for which we construct Book-of-Thoth, a high-quality, time-series-centric mid-training corpus. Book-of-Thoth enables both time-series-to-text and text-to-time-series generation, equipping LLMs with a foundational grasp of temporal patterns. To better evaluate advanced reasoning capabilities, we further present KnoTS, a novel benchmark of knowledge-intensive time series understanding, designed for joint reasoning over temporal patterns and domain knowledge. Extensive experiments demonstrate that mid-training with Book-of-Thoth enables Thoth to significantly outperform its base model and advanced LLMs across a range of time series question answering benchmarks. Moreover, Thoth exhibits superior capabilities when fine-tuned under data scarcity, underscoring the effectiveness of mid-training for time series understanding. Code is available at: https://github.com/thuml/Thoth.

时序理解大模型中段训练知识推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。