首个面向恶劣天气的开源协同感知数据集,助力自动驾驶在雨雾等条件下提升感知能力。
Adver-City: Open-Source Multi-Modal Dataset for Collaborative Perception Under Adverse Weather Conditions
- 基于CARLA与OpenCDA构建,模拟六类恶劣天气下的车辆与路侧单元多模态数据
- 含超24,000帧、89万+标注、110个真实事故场景,覆盖行人、自行车等6类目标
- 首次在合成数据集中引入强光眩光,适合评估极端条件下的协同感知模型
恶劣天气严重影响自动驾驶汽车的传感器性能,如激光雷达和摄像头。尽管协同感知(CP)能提升复杂环境下的感知能力,但现有数据集缺乏恶劣天气场景。为此,我们提出Adver-City,首个面向恶劣天气的开源合成协同感知数据集。该数据集基于CARLA与OpenCDA模拟,包含超过24,000帧图像、超过890,000个标注、110个独特场景,覆盖六种天气条件:晴天、小雨、大雨、雾、浓雾雨及首次在合成数据集中出现的强光眩光。数据涵盖车辆与路侧单元的多模态信息,包括激光雷达、RGB相机、语义分割相机、GNSS和IMU,对象类别达六类(如行人、自行车)。场景基于真实事故报告设计,覆盖高密度与低密度交通,适用于测试恶劣天气下的协同感知模型。基准测试显示,天气显著影响模型性能,CoBEVT在AP@30/50/70上得分分别为58.30/52.44/38.90。数据集、代码与文档已公开于https://labs.cs.queensu.ca/quarrg/datasets/adver-city/。
原文摘要 · Abstract (English)
Adverse weather conditions pose a significant challenge to the widespread adoption of Autonomous Vehicles (AVs) by impacting sensors like LiDARs and cameras. Even though Collaborative Perception (CP) improves AV perception in difficult conditions, existing CP datasets lack adverse weather conditions. To address this, we introduce Adver-City, the first open-source synthetic CP dataset focused on adverse weather conditions. Simulated in CARLA with OpenCDA, it contains over 24 thousand frames, over 890 thousand annotations, and 110 unique scenarios across six different weather conditions: clear weather, soft rain, heavy rain, fog, foggy heavy rain and, for the first time in a synthetic CP dataset, glare. It has six object categories including pedestrians and cyclists, and uses data from vehicles and roadside units featuring LiDARs, RGB and semantic segmentation cameras, GNSS, and IMUs. Its scenarios, based on real crash reports, depict the most relevant road configurations for adverse weather and poor visibility conditions, varying in object density, with both dense and sparse scenes, allowing for novel testing conditions of CP models. Benchmarks run on the dataset show that weather conditions created challenging conditions for perception models, with CoBEVT scoring 58.30/52.44/38.90 (AP@30/50/70). The dataset, code and documentation are available at https://labs.cs.queensu.ca/quarrg/datasets/adver-city/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。