arXiv:2606.04271cs.CVcs.AI2026-06

统一自动驾驶数据集接口,让多数据集训练更简单。

StandardE2E: A Unified Framework for End-to-End Autonomous Driving Datasets

  • 构建统一数据格式和接口,整合多个自动驾驶数据集。
  • 支持跨数据集预训练与辅助任务监督,提升模型泛化能力。
  • 新增数据集仅需映射到标准格式,适合研究者快速实验。

自动驾驶正从分模块的感知-预测-规划架构转向端到端(E2E)模型,直接将传感器输入映射为车辆控制,常通过3D检测、运动预测和高精地图感知等辅助任务进行正则化。进展依赖于日益丰富的传感器驱动数据集,但各数据集文件格式、API、坐标系和模态覆盖各不相同,导致跨数据集实验和基础预处理需重复实现。本文提出StandardE2E框架,提供统一接口管理E2E驾驶数据集:(i) 在统一数据模式下标准化各数据集的预处理;(ii) 将多个数据集合并至单一PyTorch DataLoader,支持跨数据集预训练、辅助任务监督及场景级筛选;(iii) 新增数据集仅需将原始帧映射到标准模式,下游流程无需修改。该框架开箱即用支持六个数据集:Waymo End-to-End、Waymo Perception、Argoverse 2 Sensor、Argoverse 2 LiDAR、NAVSIM(OpenScene-v1.1)和WayveScenes101,开源发布于https://github.com/stepankonev/StandardE2E。

原文摘要 · Abstract (English)

Autonomous driving has shifted from modular perception-prediction-planning stacks toward end-to-end (E2E) models that map sensor inputs directly to vehicle control, often regularized by auxiliary tasks such as 3D detection, motion forecasting, and HD-map perception. Progress is driven by a fast-growing ecosystem of sensor-rich driving datasets, yet each ships its own file formats, APIs, coordinate conventions, and modality coverage, leaving cross-dataset experimentation and even basic per-dataset preprocessing to be re-implemented per project. We present StandardE2E, a framework that provides a single unified interface over E2E driving datasets. StandardE2E (i) standardizes per-dataset preprocessing under one shared data schema; (ii) combines multiple datasets in a single PyTorch DataLoader for cross-dataset pretraining, auxiliary-task supervision, and scenario-level filtering; and (iii) reduces adding a new dataset to a single per-dataset mapping from raw frames to the canonical schema, leaving the entire downstream pipeline unchanged. The framework supports six datasets out of the box: Waymo End-to-End, Waymo Perception, Argoverse 2 Sensor, Argoverse 2 LiDAR, NAVSIM (OpenScene-v1.1), and WayveScenes101, and is released as the open-source standard-e2e Python package, available at https://github.com/stepankonev/StandardE2E.

自动驾驶数据集统一端到端PyTorch

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。