arXiv:2605.17528cs.LGcs.AI2026-05

让大模型生成的合成数据既符合因果逻辑又语义丰富。

CasualSynth: Generating Structurally Sound Synthetic Data

论文配图:CasualSynth: Generating Structurally Sound Synthetic Data
图 1 · 摘自论文原文
  • 分离因果结构与语义生成,用图模型定义变量关系
  • 在三个基准上保持因果独立性,实现率超96%
  • 可生成干预和反事实数据,适合医疗等高可靠性场景

大型语言模型(LLMs)能生成逼真的合成数据,但无法保证输出符合目标领域的因果机制。我们提出CausalSynth框架,将因果结构生成与语义实现解耦,生成兼具因果有效性和语言丰富性的合成数据。该框架分三阶段运行:首先,基于有向无环图(DAG)的结构因果模型(SCM)通过祖先采样生成满足全局马尔可夫性质的因果骨架;其次,利用70B参数的LLM作为受限“实现器”,将每个骨架映射为临床记录或交易日志等高维观测;第三,通过迭代一致性验证模块检测结构违规,并将修正指令反馈给LLM,形成闭环优化。我们识别出‘语义后门’问题——即LLMs倾向于用预训练先验覆盖设定的因果事实,并证明该迭代机制相比标准拒绝采样显著降低选择偏差。在ASIA、ALARM和MIMIC-Struct三个因果基准上,CausalSynth的假阳性率接近名义α=0.05水平,实现率超过96%。该框架还支持通过保留噪声和图破坏实现有原则的干预与反事实生成。

原文摘要 · Abstract (English)

Large Language Models (LLMs) generate realistic synthetic data but offer no guarantee that their outputs respect the causal mechanisms governing the target domain. We introduce CausalSynth, a framework that decouples causal structure generation from semantic realization, yielding synthetic data that is both causally valid and linguistically rich. The framework operates in three phases. First, a Structural Causal Model (SCM) - a tuple of structural equations defined over a directed acyclic graph (DAG) generates causal skeletons, i.e., variable assignments that satisfy the Global Markov Property of the governing DAG, via ancestral sampling. Second, an LLM acts as a constrained \emph{realizer}, a conditional translator that maps each skeleton to a high-dimensional observation such as a clinical note or a transaction log. Third, an Iterative Consistency Verification module detects structural violations through deterministic extraction and feeds targeted corrections back to the LLM, forming a closed-loop refinement process. We identify the Semantic Backdoor problem the systematic tendency of LLMs to override imposed causal facts with pre-training priors -- and prove that our iterative mechanism reduces the resulting selection bias relative to standard rejection sampling. On three causal benchmarks (ASIA, ALARM, and MIMIC-Struct), CausalSynth preserved conditional independencies with false-positive rates near the nominal $α=0.05$ level and achieved realizability rates above 96% with 70B-parameter LLM backbones. The framework additionally supports principled interventional and counterfactual generation through noise retention and graph mutilation.

因果生成合成数据大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。