arXiv:2606.24548cs.CV2026-06

测试文生图模型能否跳出常识套路,生成违背现实规则的图像。

Are Text-to-Image Models Inductivist Turkeys? A Counterfactual Benchmark for Causal Reasoning

论文配图:Are Text-to-Image Models Inductivist Turkeys? A Counterfactual Benchmark for Causal Reasoning
图 1 · 摘自论文原文
  • 设计反事实场景测试模型是否真懂因果,而非死记硬背图像关联。
  • 所有模型在反事实任务中性能骤降,暴露对常见视觉规律的依赖。
  • 适合关注AI推理能力边界、提示工程与模型可解释性的研究者。

文生图(T2I)模型在从自然语言生成逼真图像方面取得显著进展,但其成功是源于真正的因果理解,还是仅基于视觉-文本关联的模式匹配仍不明确。受罗素‘归纳主义火鸡’思想启发,我们提出反事实世界(CF-World)基准,用于检验文生图模型能否在系统违背真实世界先验规则的情境下生成图像。该基准包含三个渐进层级:常规世界知识下的真实生成、直接视觉指令下的显式反事实生成,以及需通过因果推理推断规则变化的隐式反事实生成。我们采用基于视觉语言模型(VLM)的评估器(CF-Eval)评测开源与闭源模型,并引入两项指标:先验抵抗率(PRR),衡量模型克服固有现实先验的能力;推理保持率(RRR),评估模型在无显式视觉提示时维持推理驱动的反事实生成能力。实验表明,所有模型在从真实到反事实设置中均出现明显退化。进一步分析显示,当前文生图模型将世界知识与视觉外观编码为紧密耦合的模式,导致其在训练数据中频繁共现的视觉组合上过度依赖,从而在生成反事实世界时默认回归熟悉常识先验。

原文摘要 · Abstract (English)

Text-to-image (T2I) generation models have achieved remarkable progress in producing visually realistic images from natural language prompts. Yet it remains unclear whether their success reflects genuine causal understanding or sophisticated pattern matching over visual-textual correlations. Inspired by Russell's inductivist turkey, we introduce Counterfactual-World (CF-World), a counterfactual benchmark designed to investigate whether text-to-image models can generate images under rules that systematically contradict real-world priors. CF-World organizes each scenario into three progressive levels: factual generation under ordinary world knowledge, explicit counterfactual generation with direct visual instructions, and implicit counterfactual generation requiring causal deduction from altered rules. We evaluate both open-source and closed-source T2I models using a Vision Language Model (VLM)-based evaluator (CF-Eval). Furthermore, we introduce two metrics: Prior Resistance Rate (PRR), which measures a models' ability to overcome entrenched real-world priors, and Reasoning Retention Rate (RRR), which assesses whether models can maintain reasoning-dependent counterfactual generation without explicit visual cues. Experiments show that all models exhibit sharp degradation from factual to counterfactual settings. Further analyses suggest that these failures arise because current T2I models encode world knowledge and visual appearances as tightly coupled patterns. Consequently, their heavy reliance on frequent visual co-occurrences within the training data forces them to default to familiar commonsense priors when tasked with rendering counterfactual worlds.

文生图因果推理反事实模型评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。