arXiv:2508.01583cs.RO2025-08被引 2

无需清晰参考图,模型可自适应多种恶劣天气下的感知任务。

Adverse Weather-Independent Framework Towards Autonomous Driving Perception through Temporal Correlation and Unfolded Regularization

  • 利用相邻帧时间相关性实现无参考的天气无关感知
  • 在多个恶劣天气混合场景下显著优于现有方法
  • 适合需要强泛化能力的自动驾驶视觉系统

雾、雨等恶劣天气对自动驾驶感知任务(如语义分割、目标检测)构成重大挑战。传统领域自适应方法依赖清晰图像作为参考,但实际中难以获取,且通常仅针对单一天气类型,在多种天气混合时性能下降。为此,本文提出一种无参考、不受限于特定恶劣天气条件的Advent框架。该框架利用短时内场景的稳定性,通过三个核心组件实现:(I) 局部序列机制(LSM)利用相邻帧的时间相关性,实现对任意天气的不变性;(II) 全局打乱机制(GSM)将不同位置处理的片段随机重组,防止对时间模式过拟合;(III) 展开正则化器(URs)通过深度展开实现正则项,抑制模型复杂度以提升跨天气泛化能力。以语义分割为例,大量实验表明,Advent在多种恶劣天气条件下均显著超越现有最优基线。

原文摘要 · Abstract (English)

Various adverse weather conditions such as fog and rain pose a significant challenge to autonomous driving (AD) perception tasks like semantic segmentation, object detection, etc. The common domain adaption strategy is to minimize the disparity between images captured in clear and adverse weather conditions. However, domain adaption faces two challenges: (I) it typically relies on utilizing clear image as a reference, which is challenging to obtain in practice; (II) it generally targets single adverse weather condition and performs poorly when confronting the mixture of multiple adverse weather conditions. To address these issues, we introduce a reference-free and Adverse weather condition-independent (Advent) framework (rather than a specific model architecture) that can be implemented by various backbones and heads. This is achieved by leveraging the homogeneity over short durations, getting rid of clear reference and being generalizable to arbitrary weather condition. Specifically, Advent includes three integral components: (I) Locally Sequential Mechanism (LSM) leverages temporal correlations between adjacent frames to achieve the weather-condition-agnostic effect thanks to the homogeneity behind arbitrary weather condition; (II) Globally Shuffled Mechanism (GSM) is proposed to shuffle segments processed by LSM from different positions of input sequence to prevent the overfitting to LSM-induced temporal patterns; (III) Unfolded Regularizers (URs) are the deep unfolding implementation of two proposed regularizers to penalize the model complexity to enhance across-weather generalization. We take the semantic segmentation task as an example to assess the proposed Advent framework. Extensive experiments demonstrate that the proposed Advent outperforms existing state-of-the-art baselines with large margins.

自动驾驶恶劣天气时间建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。