首个真实复杂天气下的车对车协同感知数据集,助力自动驾驶在恶劣场景下提升感知能力。
CATS-V2V: A Real-World Vehicle-to-Vehicle Cooperative Perception Dataset with Complex Adverse Traffic Scenarios
- 双车同步采集10类恶劣交通场景数据,覆盖10种天气光照条件。
- 含6万帧10Hz激光雷达点云与126万张30Hz多视角图像,标注75万条高精度3D框。
- 提供时间一致的4D BEV表示和目标级时序对齐方法,适合做协同感知研究。
车辆间协同感知在复杂恶劣交通场景(CATS)下具有显著潜力,可突破单一车辆感知局限。然而,现有数据集多集中于常规交通场景,难以支撑协同感知发展。为此,我们发布首个面向复杂恶劣交通场景的真实世界车对车协同感知数据集CATS-V2V。该数据集由两辆硬件时间同步的车辆采集,涵盖10种天气与光照条件、10个不同地理位置,共包含100段视频片段。数据包含6万帧10Hz激光雷达点云、126万张30Hz多视角相机图像,以及75万条匿名但高精度的RTK固定GNSS与IMU记录。配套提供时间一致的3D边界框标注及静态场景信息,用于构建4D鸟瞰图(BEV)表示。在此基础上,我们提出一种基于目标的时序对齐方法,确保所有传感器模态中对象的精确时空对齐。CATS-V2V是目前规模最大、支持最全、质量最高的同类数据集,有望推动自动驾驶相关任务的发展。
原文摘要 · Abstract (English)
Vehicle-to-Vehicle (V2V) cooperative perception has great potential to enhance autonomous driving performance by overcoming perception limitations in complex adverse traffic scenarios (CATS). Meanwhile, data serves as the fundamental infrastructure for modern autonomous driving AI. However, due to stringent data collection requirements, existing datasets focus primarily on ordinary traffic scenarios, constraining the benefits of cooperative perception. To address this challenge, we introduce CATS-V2V, the first-of-its-kind real-world dataset for V2V cooperative perception under complex adverse traffic scenarios. The dataset was collected by two hardware time-synchronized vehicles, covering 10 weather and lighting conditions across 10 diverse locations. The 100-clip dataset includes 60K frames of 10 Hz LiDAR point clouds and 1.26M multi-view 30 Hz camera images, along with 750K anonymized yet high-precision RTK-fixed GNSS and IMU records. Correspondingly, we provide time-consistent 3D bounding box annotations for objects, as well as static scenes to construct a 4D BEV representation. On this basis, we propose a target-based temporal alignment method, ensuring that all objects are precisely aligned across all sensor modalities. We hope that CATS-V2V, the largest-scale, most supportive, and highest-quality dataset of its kind to date, will benefit the autonomous driving community in related tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。