arXiv:2607.11510cs.LGstat.ML2026-07被引 2

提出新模型DAG-FM,用分步生成法高效发现异构因果关系。

DAG-FM: A Foundation Model for Causal Discovery under Heterogeneous Causal Mechanisms

论文配图:DAG-FM: A Foundation Model for Causal Discovery under Heterogeneous Causal Mechanisms
图 1 · 摘自论文原文
  • 分两阶段生成:先预测叶节点,再预测父节点,逐步构建因果图。
  • 在合成与真实数据上均超越现有方法,准确率和扩展性显著提升。
  • 适配未知因果机制,适合需要可解释因果推理的研究者。

从观测表格数据中进行因果发现仍具根本挑战,主要源于潜在因果机制的异质性及有向无环图(DAG)高维组合搜索空间。本文提出新型基础模型DAG-FM,通过摊销化策略实现因果发现。不同于直接矩阵预测,DAG-FM采用两个基于Transformer的专用子模块,将过程分解为两个自回归阶段:叶节点预测器与父节点预测器。为有效建模复杂的行-列交互,引入稳健的表格交互块以输出特征级表示。关键在于,针对现实场景中多样且未知的功能因果模型(FCM)假设,提出混合叶专家(MoLE)机制,使模型能动态路由并适应可识别的机制族。通过迭代推断算法,DAG-FM无缝提取因果顺序并构建有效DAG。大量实验表明,DAG-FM在合成基准与复杂真实数据集上均达到当前最优性能,显著优于传统经典算法与近期基础模型,在准确率与可扩展性方面表现突出。

原文摘要 · Abstract (English)

Causal discovery from observational tabular data remains fundamentally challenging, primarily due to the heterogeneity of underlying causal mechanisms and the high-dimensional combinatorial search space of Directed Acyclic Graphs (DAGs). In this paper, we propose \textbf{DAG-FM}, a novel foundation model architecture that amortizes causal discovery. Unlike direct matrix prediction, DAG-FM decomposes the causal discovery process into two auto-regressive stages using two specialized Transformer-based sub-modules: a leaf-node predictor and a parent-node predictor. To effectively model complex row-column interactions, we adopt a robust tabular interaction block to output feature-wise representations. Crucially, to handle diverse and unknown Functional Causal Model (FCM) assumptions in real-world scenarios, we introduce Mixture-of-Leaf-Experts (MoLE), allowing the model to dynamically route and adapt to identifiable mechanism families. Through an iterative inference algorithm, DAG-FM seamlessly extracts causal orderings and constructs valid DAGs. Extensive experiments demonstrate that DAG-FM achieves state-of-the-art performance on both synthetic benchmarks and complex real-world datasets, significantly outperforming traditional classical algorithms and recent foundation models in both accuracy and scalability.

因果发现基础模型图神经网络异构机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。