arXiv:2608.11601cs.CV2026-08

提出驾驶世界模型在反事实预测中的根本缺陷,并给出简单修复方案。

How Can Driving World Models Do Counterfactual Prediction?

论文配图:How Can Driving World Models Do Counterfactual Prediction?
图 1 · 摘自论文原文
  • 用因果推断框架揭示直接预测的机制缺陷
  • 实验证明现有模型反事实预测准确率低
  • 无需训练的简单方法显著提升预测质量

驾驶世界模型常被视作对已观测驾驶行为的反事实模拟器:给定真实驾驶日志,可推测若采取不同主车动作会如何。本文指出,直接基于动作条件的预测存在根本性偏差——它仅使用共享历史和替代动作,却忽略实际发生后的后续情况,导致生成未来时可能不保留真实事件轨迹。我们通过因果三步法(反事实推断、干预、预测)分析该问题,设计一个短时程控制仿真基准,包含真实结果与匹配的反事实结果。在两个代表性世界模型上,直接预测均未能匹配反事实真实结果。作为验证,我们提出一种无需训练的简单流水线:将真实观测信息引入反事实视角,让冻结模型补全未知部分。该方法显著提升恢复比例,并降低与匹配反事实的感知距离,验证了分析的有效性。希望本工作引起对反事实预测差距的关注,推动更优方法的发展。

原文摘要 · Abstract (English)

Driving world models are often interpreted as counterfactual simulators for observed driving episodes: given a factual driving log, they are asked what would have happened under an alternative ego action. In this paper, we identify a fundamental mismatch between this goal and direct action-conditioned prediction. The direct prediction uses the shared history and the alternative action but not the factual continuation observed after that history. It can therefore generate a plausible future without preserving what actually happened in this episode. We formalize this gap using the causal recipe of abduction, action, and prediction and study it in a setting with a short time horizon, where the alternative ego action does not alter how surrounding agents evolve. To make the gap measurable, we construct a controlled simulation benchmark with factual outcomes and matched counterfactual outcomes. Across two representative world models, direct predictions fail to match the counterfactual ground truth, supporting our analysis. As a constructive check of this analysis, we introduce a deliberately simple, training-free pipeline that moves observed evidence into the counterfactual view and lets the frozen model complete what remains unknown. Even this simple construction raises the overall recovered fraction substantially and reduces perceptual distance to the matched counterfactual on both models. We hope this work draws attention to this gap and motivates better counterfactual prediction methods for driving world models.

驾驶模拟反事实预测因果推断

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。