首个融合4D雷达的车路协同感知数据集,助力自动驾驶在恶劣天气下更安全运行。
V2X-Radar: A Multi-modal Dataset with 4D Radar for Cooperative Perception
- 构建真实世界多模态数据集,集成4D雷达、激光雷达与多视角摄像头。
- 包含20,000帧雷达数据、40,000张图像和35万标注框,覆盖多种复杂场景。
- 支持车路协同、路边感知和单车感知三类研究,提供完整基准评测。
当前自动驾驶感知系统常受限于遮挡与感知范围。合作感知可有效扩展感知范围并缓解遮挡问题,提升行车安全。近年来虽有多个合作感知数据集发布,但多聚焦于相机与激光雷达,忽视了4D雷达这一在单车自动驾驶中具有强抗恶劣天气能力的关键传感器。为此,本文提出V2X-Radar——首个大规模真实世界多模态数据集,融合4D雷达。该数据集通过连接车辆平台与智能路侧单元采集,配备4D雷达、激光雷达及多视角相机,涵盖晴天与雨天、白天、黄昏与夜间,以及多种典型挑战场景。数据集包含20,000帧激光雷达数据、40,000张图像和20,000帧4D雷达数据,共350,000个标注框,覆盖五个类别。为支持不同研究方向,我们构建了V2X-Radar-C(合作感知)、V2X-Radar-I(路侧感知)和V2X-Radar-V(单车感知)三个子集,并提供全面基准评测。所有数据集与基准代码将公开于https://huggingface.co/datasets/yanglei18/V2X-Radar 和 https://github.com/yanglei18/V2X-Radar。
原文摘要 · Abstract (English)
Modern autonomous vehicle perception systems often struggle with occlusions and limited perception range. Previous studies have demonstrated the effectiveness of cooperative perception in extending the perception range and overcoming occlusions, thereby enhancing the safety of autonomous driving. In recent years, a series of cooperative perception datasets have emerged; however, these datasets primarily focus on cameras and LiDAR, neglecting 4D Radar, a sensor used in single-vehicle autonomous driving to provide robust perception in adverse weather conditions. In this paper, to bridge the gap created by the absence of 4D Radar datasets in cooperative perception, we present V2X-Radar, the first large-scale, real-world multi-modal dataset featuring 4D Radar. V2X-Radar dataset is collected using a connected vehicle platform and an intelligent roadside unit equipped with 4D Radar, LiDAR, and multi-view cameras. The collected data encompasses sunny and rainy weather conditions, spanning daytime, dusk, and nighttime, as well as various typical challenging scenarios. The dataset consists of 20K LiDAR frames, 40K camera images, and 20K 4D Radar data, including 350K annotated boxes across five categories. To support various research domains, we have established V2X-Radar-C for cooperative perception, V2X-Radar-I for roadside perception, and V2X-Radar-V for single-vehicle perception. Furthermore, we provide comprehensive benchmarks across these three sub-datasets. We will release all datasets and benchmark codebase at https://huggingface.co/datasets/yanglei18/V2X-Radar and https://github.com/yanglei18/V2X-Radar.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。