通过可控扰动分析自动驾驶模型缺陷,揭示其依赖专家行为的弱点
PlanT 2.0: Exposing Biases and Structural Flaws in Closed-Loop Driving
- 用对象级输入设计可操控的模型,便于系统性测试失败原因
- 在CARLA Leaderboard 2.0上达到最优性能,但暴露对障碍物多样性依赖不足
- 适合研究模型偏差与数据质量的从业者,推动数据驱动开发
近期自动驾驶研究多关注基准表现和方法创新,忽视了对模型失败、偏见和捷径学习的深入分析,导致改进停留在表面。本文提出PlanT 2.0,一种轻量级、以物体为中心的规划变压器,用于CARLA中的自主驾驶研究。其对象级表示支持对输入进行精确扰动(如移动物体位置、增删特定对象),相比传感器基模型更易分析。为应对CARLA Leaderboard 2.0的新挑战,我们对PlanT进行了多项升级,在Longest6 v2、Bench2Drive及CARLA验证路线中实现最先进性能。分析揭示出关键问题:因障碍物多样性低导致场景理解不足、专家行为僵化引发可利用的捷径、过度拟合固定专家轨迹。基于此,我们主张转向以数据为中心的开发模式,强调构建更丰富、鲁棒且少偏见的数据集。代码与模型已开源。
原文摘要 · Abstract (English)
Most recent work in autonomous driving has prioritized benchmark performance and methodological innovation over in-depth analysis of model failures, biases, and shortcut learning. This has led to incremental improvements without a deep understanding of the current failures. While it is straightforward to look at situations where the model fails, it is hard to understand the underlying reason. This motivates us to conduct a systematic study, where inputs to the model are perturbed and the predictions observed. We introduce PlanT 2.0, a lightweight, object-centric planning transformer designed for autonomous driving research in CARLA. The object-level representation enables controlled analysis, as the input can be easily perturbed (e.g., by changing the location or adding or removing certain objects), in contrast to sensor-based models. To tackle the scenarios newly introduced by the challenging CARLA Leaderboard 2.0, we introduce multiple upgrades to PlanT, achieving state-of-the-art performance on Longest6 v2, Bench2Drive, and the CARLA validation routes. Our analysis exposes insightful failures, such as a lack of scene understanding caused by low obstacle diversity, rigid expert behaviors leading to exploitable shortcuts, and overfitting to a fixed set of expert trajectories. Based on these findings, we argue for a shift toward data-centric development, with a focus on richer, more robust, and less biased datasets. We open-source our code and model at https://github.com/autonomousvision/plant2.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。