arXiv:2605.26759cs.LG2026-05

通过预训练提升时间序列因果发现的跨任务泛化能力

Time Series Causal Discovery via Context-Conditioned and Causality-Augmented Pretraining

论文配图:Time Series Causal Discovery via Context-Conditioned and Causality-Augmented Pretraining
图 1 · 摘自论文原文
  • 用双尺度注意力捕捉时序因果关系,结合上下文路由处理异质外部分布
  • 在合成数据上预训练,融合干预学习与因果混元策略,增强泛化性
  • 在多个真实分布外数据集上表现优异,适合异常根因分析场景

时间序列因果发现对追踪异常根源等实际应用至关重要。现有方法多依赖特定数据集优化,难以迁移至具有不同因果机制的新时间序列。本文提出PTCD(Pretraining for Time-series Causal Discovery)框架,通过上下文条件建模和可迁移的因果增强,提升跨任务泛化能力。为建模复杂时序因果依赖,PTCD采用双尺度迭代注意力机制捕捉窗口级因果关系,并利用带有上下文路由机制的高斯混合模型处理异质外生分布。为应对因果图间的分布偏移,该框架在合成数据上采用预训练范式,整合基于干预的学习与因果混元策略,实现稳定因果发现和更强泛化能力。在多个真实世界分布外(OOD)数据集上的大量实验表明,PTCD在因果发现与根因识别方面均表现优异。

原文摘要 · Abstract (English)

Causal discovery from time series is critical for many real-world applications, such as tracing the root causes of anomalies. Existing approaches typically rely on dataset-specific optimization, making it difficult to transfer their causal discovery capabilities to new time series governed by diverse causal mechanisms. In this paper, we propose \textbf{PTCD}, a novel \textbf{P}retraining framework for \textbf{T}ime-series \textbf{C}ausal \textbf{D}iscovery, which improves cross-task generalization through context-conditioned modeling and transferable causal augmentation. To model complex temporal causal dependencies, PTCD employs a dual-scale iterative attention mechanism to capture window-level causal relationships, and a Gaussian mixture with a context-level routing mechanism to handle heterogeneous exogenous distributions. To further address distribution shifts across causal graphs, PTCD adopts a pretraining paradigm on synthetic datasets that integrates intervention-based learning and a causal mixup strategy, promoting stable causal discovery and stronger generalization. Extensive experiments on multiple real-world out-of-distribution (OOD) datasets demonstrate that PTCD excels in both causal discovery and root cause identification.

因果发现时间序列预训练泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。