arXiv:2505.16308cs.LG2025-05被引 1

区分变量因果关系,提升多变量时序预测精度

Beyond All-to-All: Causal-Aligned Transformer with Dynamic Structure Learning for Multivariate Time Series Forecasting

  • 按因果结构将历史数据分四段,分别处理不同影响
  • 动态适配器修正因果发现误差,提升模型鲁棒性
  • 适合需要解释性的时序预测场景,如金融、医疗

现有大多数多变量时间序列预测方法采用全连接范式,将所有变量的历史信息输入统一模型进行未来值预测,但未区分各变量的独立作用。这种不分化的范式难以识别变量间的因果影响,常将因果相关与虚假相关混淆。为此,本文提出一种‘一对一’预测范式:针对每个目标变量单独建模。首先从观测数据构建结构因果模型,再依据推断出的因果结构,将历史序列划分为内生、直接因果、碰撞因果和虚假相关四个子段。进一步提出因果分解变换器(CDT),通过动态因果适配器学习由因果图初始化的结构,可在训练中修正不完善的因果发现。此外,基于因果理论施加投影输出约束,缓解碰撞诱导偏差,增强模型鲁棒性。在多个基准数据集上的大量实验验证了CDT的有效性。

原文摘要 · Abstract (English)

Most existing multivariate time series forecasting methods adopt an all-to-all paradigm that feeds all variable histories into a unified model to predict their future values without distinguishing their individual roles. However, this undifferentiated paradigm makes it difficult to identify variable-specific causal influences and often entangles causally relevant information with spurious correlations. To address this limitation, we propose an all-to-one forecasting paradigm that predicts each target variable separately. Specifically, we first construct a Structural Causal Model from observational data and then, for each target variable, we partition the historical sequence into four subsegments according to the inferred causal structure: endogenous, direct causal, collider causal, and spurious correlation. Furthermore, we propose the Causal Decomposition Transformer (CDT), which integrates a dynamic causal adapter to learn causal structures initialized by the inferred graph, enabling correction of imperfect causal discovery during training. Furthermore, motivated by causal theory, we apply a projection-based output constraint to mitigate collider induced bias and improve robustness. Extensive experiments on multiple benchmark datasets demonstrate the effectiveness of the CDT.

时序预测因果推理Transformer多变量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。