arXiv:2510.27544cs.AIcs.FL2025-10

LLM在因果推理上依赖模拟而非真正理解,导致关键决策失误。

TempoBench: Reasoning Execution Without Causal Attribution Is Just Simulation

  • 用可验证的时序基准测试隔离因果归因问题
  • 模型前向模拟准确率达96%,反事实推理仅32%正确
  • 适合关注模型真实因果理解能力的研究者

当前训练范式使大语言模型擅长模式匹配和推理轨迹前向模拟,但在反事实因果理解方面表现不佳。我们提出TempoBench,首个可形式化验证的时序基准,能分离执行轨迹中的反事实因果归因。基于合成的确定性梅利机,该基准提供无限可扩展、可控复杂度且有严格因果标签的问题集。前沿模型在前向模拟任务中达96%步准确率,但面对必要输入识别问题时骤降至32%,暴露‘模拟/最小必要’差距(SIM/MIN gap)。模型常将‘可能输入’误认为‘必要原因’,无法判断哪些输入不必要。这一缺陷在调试、根因分析与任务规划等需要反事实推理的场景中尤为严重。在TempoBench上训练可提升开源模型在因果基准的表现,同时保持在通用、数学和代码推理数据集上的性能,表明反事实因果推理是可学习的、独立于现有推理能力的架构性能力。

原文摘要 · Abstract (English)

Current training paradigms, optimized for long-horizon reasoning trace execution, have made Large Language Models (LLMs) excel at pattern matching and forward simulation of reasoning, but underperform at counterfactual causal understanding and reasoning. We introduce TempoBench, the first formally verifiable temporal benchmark that isolates counterfactual causal attribution over execution trajectories, and we show that LLMs categorically fall back to brute-force simulation-based reasoning to solve causal reasoning problems. Built from synthesized deterministic Mealy machines, TempoBench provides an infinitely scalable corpus of trajectory-based causal reasoning problems with controllable complexity and provably correct causal labels. Frontier models reach 96% step accuracy simulating a system forward, and fall to 32% when asked which inputs were necessary for an observed output, displaying what we call the SIM/MIN gap. Our findings show that LLMs cannot reliably identify minimal necessary causes, often confusing ``possible inputs'' with ``necessary causes,'' demonstrating an inability to understand which inputs were not needed. This failure is critical for deployment in causal inference tasks such as debugging, root cause analysis, and task planning where agents must use counterfactual reasoning to plan for specific desired outcomes. We show that training on TempoBench yields a targeted gain on causal benchmarks in open-source models while matching general-purpose, math, and code reasoning datasets on standard benchmarks. This indicates counterfactual causal reasoning is a learnable, architecturally distinct capability that sits on top of existing reasoning competencies.

因果推理大模型评估反事实

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。