arXiv:2606.28757cs.CVcs.RO2026-06被引 1

用物理规律检验世界模型生成的多智能体动态是否可信。

A Physics-Grounded Benchmark for Multi-Agent Dynamics in World Models

论文配图:A Physics-Grounded Benchmark for Multi-Agent Dynamics in World Models
图 1 · 摘自论文原文
  • 构建合成与真实碰撞数据集,实现无标定视频的3D物理属性重建。
  • 发现高视觉质量模型在复杂交互中常严重违反物理定律。
  • 适合关注自动驾驶仿真可靠性的研究者使用。

生成式世界模型有望作为自主系统的大规模模拟器,尤其适用于生成罕见但关键的安全事件,如车辆碰撞。然而,现有评估范式过度依赖视觉保真度和语义对齐,忽视了生成动态是否符合基本物理规律这一核心问题。由于缺乏物理度量标准,且难以从非标定视频中提取尺度化运动学信息,该问题长期未被有效解决。为此,我们提出CrashTwin——一个基于物理的评估框架,用于压力测试世界模型的物理可信度。它结合包含2.5万条可控合成与1.2万条真实世界碰撞序列的多样化数据集,以及一种新型无标定重建流程,可直接从世界模型回放中恢复3D物理属性。我们设计了一套诊断工具,系统评估时空一致性、动量与动能守恒、世界动态完整性三个维度。对前沿模型的广泛基准测试揭示:高感知质量常掩盖复杂交互中的严重物理违规。CrashTwin通过定量暴露这些失效模式,为开发具备物理根基的世界模型提供关键诊断工具。

原文摘要 · Abstract (English)

Generative world models hold immense promise as scalable simulators for autonomous systems, particularly for synthesizing rare but safety-critical multi-agent interactions, such as vehicle collisions. However, current evaluation paradigms index heavily on visual fidelity and semantic alignment, leaving a critical blind spot: they cannot reliably quantify whether generated dynamics actually obey the fundamental physical laws required for reliable simulation. Assessing this physical plausibility is inherently difficult due to a lack of physical metrics and the challenge of extracting metric-scale kinematics from uncalibrated video rollouts. To bridge this gap, we introduce CrashTwin, a physics-grounded evaluation framework designed to stress-test the physical trustworthiness of world models. CrashTwin couples a diverse dataset of multi-agent collision scenarios, comprising 25K controllable synthetic and 12K in-the-wild real-world collision sequences with a novel calibration-free reconstruction pipeline, enabling the recovery of 3D physical attributes directly from world model rollouts. We propose a diagnostic suite that systematically evaluates three dimensions: spatio-temporal consistency, momentum and kinetic energy conservation, and world-dynamics integrity. Extensive benchmarking of state-of-the-art models reveals a crucial insight: high perceptual quality frequently masks severe physical violations during complex interactions. By quantitatively exposing these failure modes, CrashTwin provides a vital diagnostic tool for developing physically grounded world models capable of reliable real-world simulation.

世界模型物理验证多智能体仿真评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。