通过预训练提升时间序列因果发现的跨任务泛化能力
Time Series Causal Discovery via Context-Conditioned and Causality-Augmented Pretraining

- 用双尺度注意力捕捉时序因果关系,结合上下文路由处理异质外部分布
- 在合成数据上预训练,融合干预学习与因果混元策略,增强泛化性
- 在多个真实分布外数据集上表现优异,适合异常根因分析场景
时间序列因果发现对追踪异常根源等实际应用至关重要。现有方法多依赖特定数据集优化,难以迁移至具有不同因果机制的新时间序列。本文提出PTCD(Pretraining for Time-series Causal Discovery)框架,通过上下文条件建模和可迁移的因果增强,提升跨任务泛化能力。为建模复杂时序因果依赖,PTCD采用双尺度迭代注意力机制捕捉窗口级因果关系,并利用带有上下文路由机制的高斯混合模型处理异质外生分布。为应对因果图间的分布偏移,该框架在合成数据上采用预训练范式,整合基于干预的学习与因果混元策略,实现稳定因果发现和更强泛化能力。在多个真实世界分布外(OOD)数据集上的大量实验表明,PTCD在因果发现与根因识别方面均表现优异。
原文摘要 · Abstract (English)
Causal discovery from time series is critical for many real-world applications, such as tracing the root causes of anomalies. Existing approaches typically rely on dataset-specific optimization, making it difficult to transfer their causal discovery capabilities to new time series governed by diverse causal mechanisms. In this paper, we propose \textbf{PTCD}, a novel \textbf{P}retraining framework for \textbf{T}ime-series \textbf{C}ausal \textbf{D}iscovery, which improves cross-task generalization through context-conditioned modeling and transferable causal augmentation. To model complex temporal causal dependencies, PTCD employs a dual-scale iterative attention mechanism to capture window-level causal relationships, and a Gaussian mixture with a context-level routing mechanism to handle heterogeneous exogenous distributions. To further address distribution shifts across causal graphs, PTCD adopts a pretraining paradigm on synthetic datasets that integrates intervention-based learning and a causal mixup strategy, promoting stable causal discovery and stronger generalization. Extensive experiments on multiple real-world out-of-distribution (OOD) datasets demonstrate that PTCD excels in both causal discovery and root cause identification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。