无需感知标注,直接从传感器数据生成驾驶轨迹
TrajDiff: End-to-end Autonomous Driving without Perception Annotation
- 用轨迹引导的鸟瞰图特征提取,无需感知监督
- 在无标注环境下达到87.5 PDMS,数据量增大可至88.5 PDMS
- 适合追求端到端、低标注成本自动驾驶系统的研究者
端到端自动驾驶系统直接从原始传感器输入生成驾驶策略。尽管这类系统能有效提取环境特征用于规划,但依赖辅助感知任务导致标注成本高昂。本文提出TrajDiff,一种面向轨迹的鸟瞰图条件扩散框架,构建了完全无需感知标注的生成式端到端自动驾驶方法。TrajDiff仅需原始传感器输入和未来轨迹,通过高斯鸟瞰图热力图目标自动捕捉驾驶模式。设计了简单有效的轨迹导向鸟瞰图编码器(TrajBEV),无需感知监督即可提取特征。进一步提出轨迹导向鸟瞰图扩散变压器(TB-DiT),结合自车状态与预测的TrajBEV特征,直接生成多样且合理的轨迹,无需人工设计运动先验。除了架构创新,还探索了无标注设置下的数据规模收益。在NAVSIM基准上,TrajDiff达到87.5 PDMS,优于所有现有无标注方法;数据扩展后提升至88.5 PDMS,接近先进感知依赖方法。代码与模型将公开。
原文摘要 · Abstract (English)
End-to-end autonomous driving systems directly generate driving policies from raw sensor inputs. While these systems can extract effective environmental features for planning, relying on auxiliary perception tasks, developing perception annotation-free planning paradigms has become increasingly critical due to the high cost of manual perception annotation. In this work, we propose TrajDiff, a Trajectory-oriented BEV Conditioned Diffusion framework that establishes a fully perception annotation-free generative method for end-to-end autonomous driving. TrajDiff requires only raw sensor inputs and future trajectory, constructing Gaussian BEV heatmap targets that inherently capture driving modalities. We design a simple yet effective trajectory-oriented BEV encoder to extract the TrajBEV feature without perceptual supervision. Furthermore, we introduce Trajectory-oriented BEV Diffusion Transformer (TB-DiT), which leverages ego-state information and the predicted TrajBEV features to directly generate diverse yet plausible trajectories, eliminating the need for handcrafted motion priors. Beyond architectural innovations, TrajDiff enables exploration of data scaling benefits in the annotation-free setting. Evaluated on the NAVSIM benchmark, TrajDiff achieves 87.5 PDMS, establishing state-of-the-art performance among all annotation-free methods. With data scaling, it further improves to 88.5 PDMS, which is comparable to advanced perception-based approaches. Our code and model will be made publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。