arXiv:2506.20347cs.LGstat.ML2025-06

用预测能力反推时间序列因果结构,无需额外设计损失函数。

Emergent Granger Causality in Neural Networks: Can Prediction Alone Reveal Structure?

  • 通过比较残差分布变化,从联合预测模型中挖掘隐含因果关系。
  • 正则化良好的模型在充足数据下可自动学习真实因果结构。
  • 简单联合模型优于需调参的稀疏回归,适合初学者快速验证。

格兰杰因果(Granger Causality, GC)为多变量时间序列关联性研究提供了简洁的统计框架。向量自回归模型(VAR)虽易拟合但难以捕捉复杂(如非线性)关联。现有方法利用深度神经网络(DNN)的函数逼近能力实现GC,但通常将其视为变量选择问题。本文提出新范式:通过单一神经网络联合建模所有时间序列分量,基于预测性能与残差分布偏移来揭示学习到的GC结构。我们通过对比使用全部历史与剔除特定分量时的模型不确定性或残差分布,识别因果关系。实验表明,在充分训练数据和适当正则化下,模型无需显式添加变量选择项即可学习真实因果结构。还比较了CNN、LSTM与Transformer在发现格兰杰因果上的表现,结果表明:相比稀疏回归模型,简单的联合建模是强大的基线方法,无需额外调参。

原文摘要 · Abstract (English)

Granger Causality (GC) offers an elegant statistical framework to study the association between multivariate time series data. Vector autoregressive models (VAR) are simple and easy to fit, but have limited application because of their inherent inability to capture more complex (e.g., non-linear) associations. Numerous attempts have already been made in the literature that exploit the functional approximation power of deep neural networks (DNNs) for GC. However, these methods treat GC as a variable selection problem. We present a novel paradigm for investigating the learned GC from a single neural network used for joint modeling of all components of multivariate time series data, which is essentially linked with prediction and assessing the distribution shift in residuals. A deep learning model, with proper regularization, may learn the true GC structure when jointly used for all components of the time series when there is sufficient training data. We propose to uncover the learned GC structure by comparing the model uncertainty or distribution of the residuals when the past of everything is used as compared to the one where a specific time series component is dropped from the model. We also compare the effect of input layer dropout on the ability of a neural network to learn GC. We show that a well-regularized model can learn the true GC structure from the data without explicitly adding terms in the loss function that guide the model to select variables or perform sparse regression under specific settings. We also provide a comparison of deep learning architectures such as CNN, LSTM and transformer models on their ability to discover Granger Causality. The numerical experiments demonstrate that, compared to sparse regression models, a simple joint model is a strong baseline for learning the true GC which has the advantage that it does not require tuning of many extra hyper-parameters.

因果推断深度学习时间序列

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。