arXiv:2608.18035cs.CV2026-08中稿 · ECCV

让自动驾驶系统学会识别交通灯和路牌,显著提升行驶表现。

Plug-and-Play Traffic Element Awareness for End-to-End Autonomous Driving

论文配图:Plug-and-Play Traffic Element Awareness for End-to-End Autonomous Driving
图 1 · 摘自论文原文
  • 通过插件式设计,将交通元素信号无缝接入各类自动驾驶模型
  • 在多个数据集上均实现性能提升,NAVSIM-v2上达成新基准
  • 适用于感知-预测-规划、视觉语言动作等多种主流架构

交通灯和道路标志对人类驾驶决策至关重要,但现有端到端自动驾驶研究多聚焦于动态道路参与者(如车辆与行人),对交通元素的作用缺乏系统研究。主要因公开数据集缺少结构化标注,且模型架构差异大。本文首次系统探究端到端自动驾驶中的交通元素感知问题,通过为多个公开数据集添加全面的交通元素标注,构建统一研究基础设施。采用最小化、通用化的集成设计,以近乎无修改的方式将交通元素信号融入现有流程。在nuScenes、NAVSIM-v1、NAVSIM-v2和Bench2Drive上,评估了包括感知-预测-规划流水线、视觉语言动作模型(VLA)、基于回归的规划器、基于扩散的策略及轨迹评分框架在内的多种现代范式。结果表明,该简单集成在所有范式和数据集上均稳定提升性能,证明交通元素感知是鲁棒且可泛化的信号。尤其在具有挑战性的NAVSIM-v2基准上,显著超越当前最优架构与数据流程,建立新基准。

原文摘要 · Abstract (English)

Traffic elements such as traffic lights and road signs play a fundamental role in human driving decisions and should naturally influence end-to-end driving performance. However, existing end-to-end driving research predominantly focuses on dynamic road participants (e.g., vehicles and pedestrians), while the role of traffic elements remains largely unexplored. The community still lacks a systematic study quantifying their impact, largely because public datasets rarely provide structured traffic-element annotations and modern driving systems vary widely in architecture and training paradigm. In this work, we present the first systematic investigation of traffic element awareness for end-to-end autonomous driving. We construct a unified research infrastructure by augmenting multiple public driving datasets with comprehensive traffic-element annotations. To support diverse model families, we adopt a minimal and universal integration design that incorporates traffic-element signals into existing pipelines in a plug-and-play manner with negligible architectural modification. We evaluate this design across modern paradigms, including perception-prediction-planning pipelines, vision-language-action models (VLA), regression-based planners, diffusion-based policies, and trajectory-scoring frameworks, on nuScenes, NAVSIM-v1, NAVSIM-v2, and Bench2Drive. Across all paradigms and datasets, this simple integration consistently improves driving performance, demonstrating that traffic element awareness provides a robust and generalizable signal for end-to-end driving systems. Notably, on the challenging NAVSIM-v2 benchmark, our approach significantly improves state-of-the-art architectures and data pipelines, establishing a new state of the art.

自动驾驶交通感知端到端插件设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。