用残差动作链建模自动驾驶长时决策,提升风险感知与控制精度。
LIDAR-AD: A Decoder-Free Latent-Interaction Dreamer with Action-Residual Chains for Autonomous Driving

- 通过隐空间对齐替代重建,压缩多源观测中的无关冗余信息。
- 采用残差动作更新与对比学习,实现连续控制与未来状态对齐。
- 在模拟与真实场景均表现优异,适合长时序自动驾驶决策任务。
自动驾驶需在动态交通环境中进行长时间闭环决策。隐空间世界模型通过在紧凑隐空间中进行想象式决策,为该问题提供了有效框架。然而,多源观测包含大量与控制无关的冗余信息,而可靠的驾驶决策依赖于风险相关关系、未来动态及连续动作调整。这一差异导致观测重建与绝对动作建模在学习决策相关隐动态方面表现不佳。本文提出LIDAR-AD,一种无需解码器的隐交互梦想者模型,结合动作残差链用于自动驾驶。该模型以冗余减少的隐空间对齐替代观测重建,促进多源驾驶输入中风险相关关系的紧凑表示;进一步将车辆控制建模为残差动作更新,并利用残差动作序列对比学习,使多步残差驱动的回溯轨迹与未来隐状态对齐。确定性分析表明,隐空间-tanh残差参数化能保持动作可达性,同时以紧凑局部更新表示平滑长时控制。上述设计共同提升了风险感知状态抽象、连续控制建模与长时动态预测能力。在多样化模拟场景中的大量实验表明,LIDAR-AD持续优于基线世界模型,获得最高奖励与最佳成功率。在基于nuPlan重构的日志场景评估中,进一步验证了其在真实交通布局下的可迁移性。
原文摘要 · Abstract (English)
Autonomous driving requires long-horizon closedloop decision making in dynamic traffic environments. Latent world models offer an effective framework for this problem by enabling imagination-based decision making in compact latent spaces. However, multi-source observations contain controlirrelevant redundancy, whereas reliable driving decisions rely on risk-relevant relations, future dynamics, and continuous action adjustments. This mismatch makes observation reconstruction and absolute action modeling suboptimal for learning decisionrelevant latent dynamics. We propose LIDAR-AD, a decoderfree Latent-Interaction Dreamer with Action-Residual Chains for autonomous driving. LIDAR-AD replaces observation reconstruction with redundancy-reduced latent alignment, encouraging compact representations of risk-relevant relations in multi-source driving inputs. It further models vehicle control as residual action updates and uses residual-action sequence contrastive learning to align multi-step residual-driven rollouts with future latent states. A deterministic analysis shows that the latent-tanh residual parameterization preserves interior action reachability while representing smooth long-horizon control as compact local updates. Together, these designs improve risk-aware state abstraction, continuous-control modeling, and long-horizon dynamics prediction. Extensive experiments across diverse simulated driving scenarios demonstrate that LIDAR-AD consistently outperforms world-model baselines, achieving the highest reward and the best success rate among learning-based methods. Evaluations on nuPlan-derived log-reconstructed scenarios further demonstrate the transferability of LIDAR-AD under real-world traffic layouts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。