通过残差建模与归一化优化,提升端到端自动驾驶轨迹预测的稳定性与安全性。
ResAD: Normalized Residual Trajectory Modeling for End-to-End Autonomous Driving
- 以惯性路径为先验,预测偏离量而非直接输出轨迹
- 在NAVSIM v1/v2上分别达到88.8/85.5 PDMS,仅用两步去噪
- 适合关注长期规划鲁棒性的自动驾驶研究者
端到端自动驾驶系统从传感器数据直接预测未来轨迹,面临轨迹数据固有的时空不平衡问题。这种不平衡带来显著优化负担,导致模型学习虚假相关性而非稳健的驾驶逻辑,且过度关注不确定的远期预测,影响实时安全。为此,我们提出ResAD——一种归一化残差轨迹建模框架。不直接预测轨迹,而是预测相对于确定性惯性参考路径的残差偏差。该参考路径作为强物理先验,迫使模型超越简单模式匹配,聚焦于学习上下文驱动的偏离(如交通规则、障碍物)。为缓解长时程不确定性带来的优化失衡,ResAD进一步引入逐点归一化,重新加权优化目标,防止远距离高误差主导学习信号。在NAVSIM v1和v2基准上,ResAD仅用两步去噪即达88.8 PDMS和85.5 EPDMS,显著简化学习任务并提升规划性能。代码将公开以促进后续研究。
原文摘要 · Abstract (English)
End-to-end autonomous driving (E2EAD) systems, which learn to predict future trajectories directly from sensor data, are fundamentally challenged by the inherent spatio-temporal imbalance of trajectory data. This imbalance creates a significant optimization burden, causing models to learn spurious correlations instead of robust driving logic, while also prioritizing uncertain, distant predictions, thereby compromising immediate safety. To address these issues, we propose ResAD, a novel Normalized Residual Trajectory Modeling framework. Instead of predicting the future trajectory directly, our approach reframes and simplifies the learning task by predicting the residual deviation from a deterministic inertial reference. This inertial reference serves as a strong physical prior, compelling the model to move beyond simple pattern-matching and instead focus its capacity on learning the necessary, context-driven deviations (e.g., traffic rules, obstacles) from this default, inertially-guided path. To mitigate the optimization imbalance caused by uncertain, long-term horizons, ResAD further incorporates Point-wise Normalization of the predicted residual. This technique re-weights the optimization objective, preventing large-magnitude errors associated with distant, uncertain waypoints from dominating the learning signal. On the NAVSIM v1 and v2 benchmarks, ResAD achieves state-of-the-art results of 88.8 PDMS and 85.5 EPDMS with only two denoising steps, demonstrating that ResAD significantly simplifies the learning task and improves planning performance. The code will be released to facilitate further research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。