通过学习失败案例提升自动驾驶安全性,让模型避开危险轨迹。
Beyond Imitation: Learning Safe End-to-End Autonomous Driving from Hard Negatives

- 用生成对抗轨迹的方法模拟高危但接近专家路径的失败行为。
- 在闭环测试中达89.7 PDMS,显著优于现有方法。
- 适合需要高安全性的自动驾驶系统研发与测试人员。
当前端到端自动驾驶的模仿学习主要基于成功示范,通过最小化与专家轨迹的几何偏差来训练,这种范式隐含假设空间接近即安全,导致严重目标错位:相似的模仿损失可能对应截然不同的安全性结果,一个可恢复,另一个则导致碰撞。为此,我们提出BeyondDrive,一种兼顾成功与失败行为的学习框架。首先,设计基于流匹配的负样本轨迹生成器,合成高危但贴近专家路径的轨迹,显式建模安全不对称性。其次,提出多样性感知采样策略,缓解模式崩溃,提升失败模式覆盖。第三,引入排斥距离损失,使预测同时靠近专家轨迹、远离困难负样本,从而在轨迹空间建立可区分的安全边界。应用于单模态基线模型Latent TransFuser,在NAVSIMv1闭环基准上取得89.7 PDMS,超越现有最优方法。该框架还可泛化至多模态规划器,并在HUGSIM基准上实现强零样本迁移能力。
原文摘要 · Abstract (English)
Existing imitation learning methods for end-to-end autonomous driving predominantly learn from successful demonstrations by minimizing geometric deviations from expert trajectories. This paradigm implicitly assumes that spatial proximity implies behavioral safety, leading to a critical objective mismatch: trajectories with nearly identical imitation losses may exhibit drastically different safety outcomes, where one remains recoverable while the other results in collision. To address this limitation, we propose BeyondDrive, a failure-aware imitation learning framework that jointly learns from successful and failed driving behaviors. First, we introduce a flow matching-based negative trajectory generator that synthesizes safety-critical yet expert-proximate trajectories, enabling explicit modeling of safety asymmetry. Second, we develop a diversity-aware sampling strategy that mitigates mode collapse and improves coverage of diverse failure modes during negative trajectory generation. Third, we propose a Repulsive Distance Loss that simultaneously attracts predictions toward expert demonstrations while repelling them from hard negative trajectories, thereby establishing discriminative safety boundaries in trajectory space. Applied to the uni-modal baseline Latent TransFuser, BeyondDrive achieves 89.7 PDMS on the NAVSIMv1 closed-loop benchmark, outperforming prior state-of-the-art methods. Moreover, BeyondDrive generalizes effectively across different autonomous driving architectures, including multi-modal planners, and further demonstrates strong zero-shot transferability on the HUGSIM benchmark.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。