用自修正智能体生成罕见驾驶故障数据,提升自动驾驶规划鲁棒性。
CorrectAD: A Self-Correcting Agentic System to Improve End-to-end Planning in Autonomous Driving
- 构建智能体自动识别故障案例并生成对应数据
- 在nuScenes和自研数据集上分别纠正62.5%和49.8%的失败案例
- 无需修改原模型,可适配任意端到端规划器
端到端规划是当前自动驾驶系统的主流方法,但其鲁棒性受长尾问题(即罕见但危及安全的故障场景)影响。本文探索利用基于扩散的视频生成模型(世界模型)与结构化3D布局,构建全自动自修正流程以应对此类故障。首先引入模拟产品经理角色的PM-Agent,用于制定数据采集需求;随后采用生成模型模拟数据收集与标注过程。针对现有生成模型难以精准生成符合3D布局的高保真视频的问题,提出DriveSora,实现时空一致且与PM-Agent请求对齐的视频生成。将上述组件集成至自修正智能体系统CorrectAD中。该系统为端到端、模型无关,可提升任意端到端规划器性能。在nuScenes与更具挑战性的自研数据集上评估,CorrectAD分别纠正62.5%和49.8%的失败案例,碰撞率降低39%和27%。
原文摘要 · Abstract (English)
End-to-end planning methods are the de facto standard of the current autonomous driving system, while the robustness of the data-driven approaches suffers due to the notorious long-tail problem (i.e., rare but safety-critical failure cases). In this work, we explore whether recent diffusion-based video generation methods (a.k.a. world models), paired with structured 3D layouts, can enable a fully automated pipeline to self-correct such failure cases. We first introduce an agent to simulate the role of product manager, dubbed PM-Agent, which formulates data requirements to collect data similar to the failure cases. Then, we use a generative model that can simulate both data collection and annotation. However, existing generative models struggle to generate high-fidelity data conditioned on 3D layouts. To address this, we propose DriveSora, which can generate spatiotemporally consistent videos aligned with the 3D annotations requested by PM-Agent. We integrate these components into our self-correcting agentic system, CorrectAD. Importantly, our pipeline is an end-to-end model-agnostic and can be applied to improve any end-to-end planner. Evaluated on both nuScenes and a more challenging in-house dataset across multiple end-to-end planners, CorrectAD corrects 62.5% and 49.8% of failure cases, reducing collision rates by 39% and 27%, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。