融合视觉、惯性与毫米波雷达,提升恶劣天气下车辆定位精度
Raci-Net: Ego-vehicle Odometry Estimation in Adverse Weather Conditions

- 动态融合多传感器数据,根据环境自动调节各传感器权重
- 在Boreas数据集上验证,雪雨天定位误差显著低于传统方法
- 适合自动驾驶系统在复杂天气中保持稳定定位
自动驾驶系统依赖相机、激光雷达和惯性测量单元(IMU)感知环境并估计自身运动。其中,基于感知的传感器易受恶劣天气和故障影响。尽管现有方法对旋转错位、断连等常见问题具有鲁棒性,但在动态环境如天气变化时性能下降。本文提出一种新型深度学习运动估计算法,融合视觉、惯性与毫米波雷达数据,利用各传感器优势,在雪、雨及光照变化等恶劣条件下提升里程计估计的准确性和可靠性。模型采用先进传感器融合技术,根据当前环境动态调整各传感器贡献,雷达在能见度低时补偿视觉传感器不足。在Boreas数据集上的实验表明,该方法在清晰和退化环境中均表现优异。
原文摘要 · Abstract (English)
Autonomous driving systems are highly dependent on sensors like cameras, LiDAR, and inertial measurement units (IMU) to perceive the environment and estimate their motion. Among these sensors, perception-based sensors are not protected from harsh weather and technical failures. Although existing methods show robustness against common technical issues like rotational misalignment and disconnection, they often degrade when faced with dynamic environmental factors like weather conditions. To address these problems, this research introduces a novel deep learning-based motion estimator that integrates visual, inertial, and millimeter-wave radar data, utilizing each sensor strengths to improve odometry estimation accuracy and reliability under adverse environmental conditions such as snow, rain, and varying light. The proposed model uses advanced sensor fusion techniques that dynamically adjust the contributions of each sensor based on the current environmental condition, with radar compensating for visual sensor limitations in poor visibility. This work explores recent advancements in radar-based odometry and highlights that radar robustness in different weather conditions makes it a valuable component for pose estimation systems, specifically when visual sensors are degraded. Experimental results, conducted on the Boreas dataset, showcase the robustness and effectiveness of the model in both clear and degraded environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。