通过显式建模车辆自身运动,提升自动驾驶世界模型的泛化与准确性。
Ego-Dynamics-Augmented World Model for Autonomous Driving with Zero-Shot Cross-Chassis Adaptation

- 引入物理启发的车辆动态编码器,分离车辆自身运动与环境变化。
- 在城市和高速场景中分别提升任务成功率28%和61%。
- 无需重新训练即可适配未见过的车辆底盘,支持零样本跨车型迁移。
基于世界模型(WM)的强化学习可通过潜空间想象长时程轨迹实现高效的端到端自动驾驶学习。然而,多数驾驶世界模型依赖鸟瞰图(BEV)表示,其本质为自车中心:连续帧间的变换将自车运动与场景动态纠缠在一起。这导致模型大量资源用于从扭曲观测中恢复自车运动,牺牲了场景建模精度与想象准确性。本文提出DynaDreamer,一种动态增强型Dreamer式强化学习方法,通过引入显式的自车动态先验来解决该问题。一个物理启发的自车动态编码器-解码器将自车状态历史压缩为紧凑可识别的上下文,该上下文调节因果Transformer世界模型,以条件化其先验与后验潜变量。在想象过程中,自车动态预测器向前传播该上下文,保持动态先验与滚动预测同步。信息论分析表明,该上下文条件化显著降低了观测转移的预测熵以及先验与后验之间的KL散度,使模型聚焦于自车运动之外的场景动态。额外优势在于零样本跨车型适应:自车动态上下文依赖可识别的底盘参数,因此具备未知动态特性的车辆可在不重训练的情况下适配新底盘。实验表明,DynaDreamer在城市与高速公路场景中相比最强基线分别提升任务成功率28%和61%,在推广至未见底盘时优势更达73%。
原文摘要 · Abstract (English)
World model (WM)-based reinforcement learning enables sample-efficient end-to-end autonomous driving learning by imagining long-horizon trajectories in latent space. However, most driving WMs operate on bird's-eye-view (BEV) representations that are inherently egocentric: the transition between consecutive frames entangles the ego vehicle's own motion with scene dynamics. As a result, the WM devotes significant capacity to recovering ego-motion from warped observations, at the cost of scene modeling fidelity and imagination accuracy. This work proposes DynaDreamer, a dynamics-augmented Dreamer-style reinforcement learning method to address this problem by augmenting the WM with an explicit ego-dynamics prior. A physics-informed ego-dynamics encoder-decoder extracts the ego-state history into a compact and identifiable context, which modulates a causal Transformer WM to condition both its prior and posterior latents. During imagination, the ego-dynamics predictor propagates this context forward to keep the ego-dynamics prior synchronized with the rollout. An information-theoretic analysis shows that conditioning on this context reduces both the predictive entropy of the observation transition and the prior--posterior Kullback--Leibler divergence, confining the WM's modeling burden to the scene dynamics beyond ego-motion. An additional benefit is zero-shot cross-chassis adaptation: the ego-dynamics context depends on identifiable chassis parameters, so that a vehicle with previously unseen dynamic characteristics can adapt the WM to the new chassis without retraining. Experiments demonstrate that DynaDreamer improves task success rates over the strongest baseline by 28% and 61% in urban and highway driving scenarios, respectively, with the advantage rising to 73% when extrapolating to unseen chassis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。