构建首个仿真停车数据集,助力端到端自动泊车学习。
ParkingScenes: A Structured Dataset for End-to-End Autonomous Parking in Simulation Scenes

- 用混合A*与模型预测控制生成结构化泊车轨迹
- 含704个场景、10.5万帧多模态数据,覆盖多种行人情况
- 适合研究端到端泊车算法的学者和工程师
自主泊车是智能驾驶中的关键挑战,尤其在空间受限的城市环境中。尽管端到端学习进展迅速,但缺乏高质量、结构化的泊车数据集仍是瓶颈。为此,我们提出ParkingScenes,一个基于CARLA模拟器的多模态数据集,专为端到端自动泊车设计。数据集包含16种倒车入位和6种平行泊车场景,每种场景在有无行人条件下各执行16次,共生成704个结构化训练片段,约10.5万帧图像。每帧同步包含四路RGB相机、四路深度传感器、车辆运动状态及鸟瞰图(BEV)信息。通过对比在结构化数据与非结构化数据上训练的模型,结果显示使用ParkingScenes可显著提升泊车性能,验证了结构化监督的有效性。数据集与采集框架将开源,为学习型泊车系统提供可复现基准。
原文摘要 · Abstract (English)
Autonomous parking remains a critical yet challenging task in intelligent driving systems, particularly within constrained urban environments where maneuvering space is limited and precise control is essential. While recent advances in end-to-end learning have shown great promise, the lack of high-quality, structured datasets tailored for parking scenarios remains a significant bottleneck.To address this gap, we present ParkingScenes, a comprehensive multimodal dataset specifically designed for end-to-end autonomous parking in simulated scenes. Built on the CARLA simulator, ParkingScenes features structured parking trajectories generated by a Hybrid A* planner and a Model Predictive Controller (MPC), providing accurate and reproducible supervision signals. The dataset includes 16 reverse-in and 6 parallel parking scenarios, each executed under two pedestrian conditions (present and absent), resulting in 704 structured episodes and approximately 105000 frames. Each scenario is repeated 16 times to ensure consistent coverage. Each frame contains synchronized data from four RGB cameras, four depth sensors, vehicle motion states, and Bird's-Eye View (BEV) representations, enabling rich multimodal fusion and context-aware learning. To demonstrate the utility of our dataset, we compare models trained on ParkingScenes with those trained on unstructured, manually collected simulation data under identical conditions. Results show significant improvements in performance, underscoring the effectiveness of structured supervision for robust and accurate parking policy learning. By releasing both the dataset and the collection framework, ParkingScenes establishes a scalable and reproducible benchmark for advancing learning-based autonomous parking systems. The dataset and collection framework will be released at: https://github.com/haonan-ai/ParkingScenes
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。