arXiv:2602.23499cs.ROcs.AI2026-02中稿 · the Third Workshop…被引 1

构建285万帧的端到端自动驾驶数据集,支持感知与规划全链路评测。

TaCarla: A comprehensive benchmarking dataset for end-to-end autonomous driving

  • 基于CARLA Leaderboard 2.0场景采集,覆盖多样驾驶行为。
  • 包含285万帧,支持检测、预测、视觉语言等多任务训练。
  • 提供罕见状态评分,助力长尾问题研究,适合模型评估者使用。

高质量数据集的构建需精细设计,否则可能使整个数据集失效。自动驾驶研究仍面临挑战,需提升车辆感知与规划能力。然而现有数据集普遍不完整:含感知信息的数据常缺规划数据,而规划数据集多为单一方向行驶序列,行为多样性不足。此外,多数真实数据集缺乏闭环评估机制,难以有效检验模型表现。CARLA Leaderboard 2.0挑战赛提供了多样化场景,用于应对自动驾驶中的长尾问题,在开环与闭环评估中均有应用。但现有该平台数据集存在局限,部分仅适配特定传感器配置。为此,我们基于CARLA仿真环境,收集了超过285万帧数据,涵盖Leaderboard 2.0的多样化挑战场景。本数据集不仅支持规划任务,还可用于动态目标检测、车道线检测、中心线检测、交通灯识别、预测任务及视觉语言动作模型训练。我们通过实证展示了其泛化能力,并引入数值罕见度评分,以分析当前状态在数据集中出现频率。

原文摘要 · Abstract (English)

Collecting a high-quality dataset is a critical task that demands meticulous attention to detail, as overlooking certain aspects can render the entire dataset unusable. Autonomous driving challenges remain a prominent area of research, requiring further exploration to enhance the perception and planning performance of vehicles. However, existing datasets are often incomplete. For instance, datasets that include perception information generally lack planning data, while planning datasets typically consist of extensive driving sequences where the ego vehicle predominantly drives forward, offering limited behavioral diversity. In addition, many real datasets struggle to evaluate their models, especially for planning tasks, since they lack a proper closed-loop evaluation setup. The CARLA Leaderboard 2.0 challenge, which provides a diverse set of scenarios to address the long-tail problem in autonomous driving, has emerged as a valuable alternative platform for developing perception and planning models in both open-loop and closed-loop evaluation setups. Nevertheless, existing datasets collected on this platform present certain limitations. Some datasets appear to be tailored primarily for limited sensor configuration, with particular sensor configurations. To support end-to-end autonomous driving research, we have collected a new dataset comprising over 2.85 million frames using the CARLA simulation environment for the diverse Leaderboard 2.0 challenge scenarios. Our dataset is designed not only for planning tasks but also supports dynamic object detection, lane divider detection, centerline detection, traffic light recognition, prediction tasks and visual language action models . Furthermore, we demonstrate its versatility by training various models using our dataset. Moreover, we also provide numerical rarity scores to understand how rarely the current state occurs in the dataset.

自动驾驶数据集仿真端到端

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。