提出首个基于真实物理轨迹的基准,评估仿真引擎与视频世界模型的物理保真度。
GAUGE: A Measurement-Grounded Benchmark for Physical Fidelity in Simulation Engines and Video World Models

- 设计22类受控任务,覆盖刚体、柔性绳索、织物和可变形物体的物理行为。
- 发现现有仿真引擎在冲击接触、快速织物运动中误差最大,视频模型虽拟合方程但参数错误。
- 适合研究仿真、具身智能和世界模型的开发者,用于诊断物理规律违反问题。
物理引擎推动具身智能的大规模训练与评估,生成式视频世界模型正作为未来状态和交互的隐式模拟器兴起。然而,现有物理保真度评估多孤立进行,依赖感知相似性或人工判断,难以揭示具体违反的物理原理或参数。本文提出GAUGE,一个基于真实世界轨迹的诊断性基准,用于联合评估数值仿真器与生成式视频世界模型对真实物理的还原能力。该基准包含22个受控任务族,涵盖刚体、柔性缆索、纺织品及体积可变形物体,基于真实世界轨迹、校准的物理元数据、不确定性标注和任务特异性可观测量,覆盖碰撞、摩擦、动量传递、振荡、自接触及多种材料条件下的形变等基础物理过程。我们在14个任务族上用广义轨迹误差评估Isaac Sim、Genesis和Newton,在5个刚体任务上通过物理定律一致性与推断参数的时间稳定性测试6个图像到视频模型。结果表明,无一仿真引擎在所有场景下均表现忠实,最大偏差出现在冲击接触、快速织物运动和体积形变;视频世界模型虽能生成符合预期方程形式的轨迹,却恢复出错误的加速度、动量传递与振荡时机。GAUGE为构建更精确的仿真器与世界模型奠定了基础。
原文摘要 · Abstract (English)
Physics engines facilitate large-scale training and evaluation for embodied intelligence, while generative video world models are emerging as implicit simulators of future states and interactions. However, existing evaluations of physical fidelity are often conducted in isolation and rely heavily on perceptual similarity or human judgments, providing limited insight into which physical principles or parameters are violated. We introduce GAUGE, a real-world-grounded diagnostic benchmark for jointly evaluating how numerical simulators and generative video world models reproduce or deviate from real-world physics. It comprises 22 controlled task families covering rigid bodies, flexible cables, textiles, and volumetric deformable objects. Grounded in real-world trajectories and paired with calibrated physical metadata, uncertainty annotations, and task-specific observables, these tasks cover fundamental physical processes including collision, friction, momentum transfer, oscillation, self-contact, and deformation across diverse materials and conditions. We benchmark Isaac Sim, Genesis, and Newton on 14 task families using generalized trajectory errors, and evaluate 6 image-to-video models on 5 rigid-body tasks by testing physical-law consistency and the temporal stability of inferred parameters. Our results reveal no uniformly faithful physics engine, with the largest discrepancies arising in impulsive contact, rapid textile motion, and volumetric deformation. We further find that video world models can produce trajectories with the expected equation form while recovering incorrect accelerations, momentum transfer, and oscillation timing. GAUGE lays the groundwork for developing more physically faithful simulators and world models for embodied intelligence.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。