首个真实世界空地协同驾驶数据集,助力自动驾驶感知更全面。
AGC-Drive: A Large-Scale Dataset for Real-World Aerial-Ground Collaboration in Driving Scenarios
- 构建空地多视角协同感知系统,含两车一无人机采集多源数据。
- 覆盖14类场景,含17%动态交互事件,共350个场景、约80万帧数据。
- 开源工具链支持时空对齐与协同标注,适合自动驾驶研究者使用。
通过多智能体间信息共享,协同感知可缓解自动驾驶中的遮挡问题并提升整体感知精度。现有工作多聚焦车车、车路协同,对无人机(UAV)提供的动态俯视视角关注不足,而此类视角能有效缓解遮挡、监控大范围交互环境。其主要瓶颈在于缺乏高质量的空地协同数据集。为此,本文提出AGC-Drive,首个大规模真实世界空地协同3D感知数据集。数据采集平台包含两辆汽车(每辆配5个摄像头+1个LiDAR)和一架搭载前向相机与LiDAR的无人机,实现多视角、多智能体感知。数据集共包含约80,000帧LiDAR点云与360,000张图像,覆盖14种真实驾驶场景,如城市环岛、高速隧道、匝道等。其中17%的数据包含车辆切入/切出、频繁变道等动态交互事件。共350个场景,每个场景约100帧,均配有完整3D边界框标注,涵盖13类目标。我们为车车协同感知与车机协同感知任务提供基准评测。此外,发布开源工具包,包含时空对齐验证工具、多智能体可视化系统及协同标注工具。数据集与代码已开源:https://github.com/PercepX/AGC-Drive。
原文摘要 · Abstract (English)
By sharing information across multiple agents, collaborative perception helps autonomous vehicles mitigate occlusions and improve overall perception accuracy. While most previous work focus on vehicle-to-vehicle and vehicle-to-infrastructure collaboration, with limited attention to aerial perspectives provided by UAVs, which uniquely offer dynamic, top-down views to alleviate occlusions and monitor large-scale interactive environments. A major reason for this is the lack of high-quality datasets for aerial-ground collaborative scenarios. To bridge this gap, we present AGC-Drive, the first large-scale real-world dataset for Aerial-Ground Cooperative 3D perception. The data collection platform consists of two vehicles, each equipped with five cameras and one LiDAR sensor, and one UAV carrying a forward-facing camera and a LiDAR sensor, enabling comprehensive multi-view and multi-agent perception. Consisting of approximately 80K LiDAR frames and 360K images, the dataset covers 14 diverse real-world driving scenarios, including urban roundabouts, highway tunnels, and on/off ramps. Notably, 17% of the data comprises dynamic interaction events, including vehicle cut-ins, cut-outs, and frequent lane changes. AGC-Drive contains 350 scenes, each with approximately 100 frames and fully annotated 3D bounding boxes covering 13 object categories. We provide benchmarks for two 3D perception tasks: vehicle-to-vehicle collaborative perception and vehicle-to-UAV collaborative perception. Additionally, we release an open-source toolkit, including spatiotemporal alignment verification tools, multi-agent visualization systems, and collaborative annotation utilities. The dataset and code are available at https://github.com/PercepX/AGC-Drive.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。