arXiv:2602.14972cs.LG2026-02被引 4

让通用因果模型学会利用领域知识,提升预测精度。

Use What You Know: Causal Foundation Models with Partial Graphs

  • 通过可学习偏置和图卷积编码器注入因果信息
  • 在部分因果图条件下仍能匹配专用模型性能
  • 适合需要融合专家知识的因果推断场景

传统因果推断依赖针对特定假设设计的专用估计器。近期提出的因果基础模型(CFMs)试图通过一步完成因果发现与推断来实现统一。然而当前方法无法融入任何领域知识,导致预测效果不佳。本文提出在CFM中引入因果信息(如因果图或祖先关系)的条件化方法。当完整因果图不可行时,该方法仍能有效利用部分因果信息。系统评估表明,将可学习偏置注入注意力机制,并结合图卷积编码器,是高效利用完整或部分因果信息的有效策略。实验显示,这一条件化使通用CFM在性能上达到专用于特定因果结构模型的水平。整体而言,本方法解决了通向一体化因果基础模型的关键障碍:在数据驱动下回答因果问题的同时,充分整合任意程度的领域知识。

原文摘要 · Abstract (English)

Estimating causal quantities traditionally relies on bespoke estimators tailored to specific assumptions. Recently proposed Causal Foundation Models (CFMs) promise a more unified approach by amortising causal discovery and inference in a single step. However, in their current state, they do not allow for the incorporation of any domain knowledge, which can lead to suboptimal predictions. We bridge this gap by introducing methods to condition CFMs on causal information, such as the causal graph or more readily available ancestral information. When access to complete causal graph information is too strict a requirement, our approach also effectively leverages partial causal information. We systematically evaluate conditioning strategies and find that injecting learnable biases into the attention mechanism, together with a graph-convolutional encoder, is a highly effective method to utilise full and partial causal information. Our experiments show that this conditioning allows a general-purpose CFM to match the performance of specialised models trained on specific causal structures. Overall, our approach addresses a central hurdle on the path towards all-in-one causal foundation models: the capability to answer causal queries in a data-driven manner while effectively leveraging any amount of domain expertise.

因果推断基础模型图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。