用贝叶斯方法在多变量场景下无需强假设即可发现因果结构。
Continuous Bayesian Model Selection for Multivariate Causal Discovery
- 将离散模型选择连续化,结合高斯过程密度估计构建灵活因果模型。
- 通过边缘似然与无环正则项优化,得到后验最优因果图。
- 适合缺乏干预数据且需避免强假设的复杂系统因果分析。
现有因果发现方法在缺乏干预数据时需依赖严格模型假设以保证结构可识别性,但这些假设在真实场景中常不成立,导致理论保证失效且性能下降。近期研究发现,在二变量情况下,贝叶斯模型选择可通过放宽建模约束显著提升性能,仅承担轻微出错风险。本文证明该方法在重要得多变量场景同样有效。我们提出一种可扩展算法,利用离散模型选择的连续松弛,采用因果高斯过程条件密度估计器(CGP-CDE)作为贝叶斯非参数模型,通过其超参数构建邻接矩阵,并基于边缘似然与无环正则项进行优化,得到最大后验因果图。实验表明,该方法在无需不切实际假设的前提下,实现了具有竞争力的多变量因果发现性能。
原文摘要 · Abstract (English)
Current causal discovery approaches require restrictive model assumptions in the absence of interventional data to ensure structure identifiability. These assumptions often do not hold in real-world applications leading to a loss of guarantees and poor performance in practice. Recent work has shown that, in the bivariate case, Bayesian model selection can greatly improve performance by exchanging restrictive modelling for more flexible assumptions, at the cost of a small probability of making an error. Our work shows that this approach is useful in the important multivariate case as well. We propose a scalable algorithm leveraging a continuous relaxation of the discrete model selection problem. Specifically, we employ the Causal Gaussian Process Conditional Density Estimator (CGP-CDE) as a Bayesian non-parametric model, using its hyperparameters to construct an adjacency matrix. This matrix is then optimised using the marginal likelihood and an acyclicity regulariser, giving the maximum a posteriori causal graph. We demonstrate the competitiveness of our approach, showing it is advantageous to perform multivariate causal discovery without infeasible assumptions using Bayesian model selection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。