arXiv:2608.04412cs.CV2026-08

让合成的驾驶视频真实反映雨天和路面不平带来的车辆动态变化

muSync-GS: Physics-Synchronized Driving Video Synthesis for Weather and Geometric Road Hazards

论文配图:muSync-GS: Physics-Synchronized Driving Video Synthesis for Weather and Geometric Road Hazards
图 1 · 摘自论文原文
  • 用天气和路面坡度同步控制场景外观与轮胎摩擦力
  • 生成视频中车辆速度、俯仰角等物理参数误差极小
  • 适合自动驾驶仿真与复杂路况训练

高质量驾驶数据对自动驾驶系统和生成式世界模型至关重要。但恶劣天气、低附着路面制动及路面不平这类高风险场景难以大规模采集。现有视频生成与3D高斯编辑方法虽可修改天气或道路几何,却未同步耦合轮胎-路面相互作用与车辆动力学,导致编辑后视频仍保持原轨迹,与实际响应不符。本文提出muSync-GS,一种面向恶劣天气与道路高程危险的物理同步驾驶视频合成框架。基于降水推导的路面状态联合控制道路外观与轮胎摩擦力,共享道路高程剖面同时驱动可见几何编辑与车轴激励。校准的车辆模型预测速度、滑移率、法向载荷与俯仰角,用于构建自车相机轨迹与同步物理标注。在12个保留的CarSim案例中(涵盖降水强度、制动输入与道路参数),模型在速度、俯仰角、滑移率和单轮法向载荷上的均方根误差分别为0.0273 m/s、0.0590°、0.0101和26.61 N。结合重建场景实验,结果表明muSync-GS能准确复现未见工况下的车辆响应,同时与可控场景编辑和自车相机运动保持同步。

原文摘要 · Abstract (English)

High-quality driving data are essential for autonomous-driving systems and generative world models. However, rare and safety-critical scenarios involving adverse weather, braking under low tire--road friction, and uneven road geometry are costly and risky to collect at scale. Existing video-generation and 3D Gaussian editing methods can modify weather appearance or road geometry, but typically do not couple these edits with tire--road interaction and vehicle dynamics. As a result, an edited video may retain its original trajectory even when the modified road condition should alter braking, wheel slip, load transfer, and ego-camera motion. We present muSync-GS, a physics-synchronized framework for driving video synthesis under adverse-weather and road-elevation hazards. A precipitation-derived road-surface condition jointly controls road appearance and tire friction, while a shared road-elevation profile drives both visible road-geometry editing and axle excitation. A calibrated vehicle model predicts speed, slip ratio, normal loads, and pitch for constructing the ego-camera trajectory and synchronized physical annotations. On 12 held-out CarSim cases spanning precipitation levels, brake inputs, and road-profile parameters, the model achieves mean case-wise RMSEs of 0.0273 m/s for speed, 0.0590 degrees for pitch, 0.0101 for slip ratio, and 26.61 N for per-wheel normal load. Together with the reconstructed-scene experiments, these results show that muSync-GS accurately reproduces vehicle responses under held-out controls while synchronizing them with controllable scene edits and ego-camera motion.

视频生成物理模拟自动驾驶高斯溅射

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。