arXiv:2603.21987cs.CVcs.AI2026-03中稿 · publication at IEE…

融合激光雷达、毫米波雷达和摄像头,实时识别恶劣天气类型。

LRC-WeatherNet: LiDAR, RADAR, and Camera Fusion Network for Real-time Weather-type Classification in Autonomous Driving

  • 用鸟瞰图早期融合与中层门控融合,动态适应不同传感器在恶劣天气下的可靠性变化。
  • 在涵盖9种天气的MSU-4S数据集上,分类性能显著优于单一传感器模型。
  • 首个同时使用三类传感器进行实时天气分类的工作,适合自动驾驶感知系统研发者。

自动驾驶车辆在雨、雾、雪等恶劣天气下面临感知与导航挑战,这些条件会降低激光雷达、毫米波雷达和可见光相机的性能。尽管各类传感器各有优势,如毫米波雷达在能见度低时更鲁棒,激光雷达在晴朗条件下精度高,但它们在环境遮挡下也存在固有局限。本文提出LRC-WeatherNet,一种新型多传感器融合框架,集成激光雷达、毫米波雷达和相机数据,实现恶劣天气类型的实时分类。通过采用统一鸟瞰图表示的早期融合,以及模态特异性特征图的中层门控融合,该方法能根据天气变化动态调整各传感器的权重。在覆盖九种天气类型的大型MSU-4S数据集上评估,LRC-WeatherNet展现出优越的分类性能和计算效率,显著优于单一模态基线模型。本工作首次将三类传感器联合用于自动驾驶中的鲁棒、实时天气分类。相关训练模型与源代码已公开于https://github.com/nouralhudaalbashir/LRC-WeatherNet。

原文摘要 · Abstract (English)

Autonomous vehicles face major perception and navigation challenges in adverse weather such as rain, fog, and snow, which degrade the performance of LiDAR, RADAR, and RGB camera sensors. While each sensor type offers unique strengths, such as RADAR robustness in poor visibility and LiDAR precision in clear conditions, they also suffer distinct limitations when exposed to environmental obstructions. This study proposes LRC-WeatherNet, a novel multi-sensor fusion framework that integrates LiDAR, RADAR, and camera data for real-time classification of weather conditions. By employing both early fusion using a unified Bird's Eye View representation and mid-level gated fusion of modality-specific feature maps, our approach adapts to the varying reliability of each sensor under changing weather. Evaluated on the extensive MSU-4S dataset covering nine weather types, LRC-WeatherNet achieves superior classification performance and computational efficiency, significantly outperforming unimodal baselines in adverse conditions. This work is the first to combine all three modalities for robust, real-time weather classification in autonomous driving. We release our trained models and source code in https://github.com/nouralhudaalbashir/LRC-WeatherNet.

多模态融合自动驾驶天气分类传感器融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。