arXiv:2409.03249cs.CV2024-09被引 1

提出自适应多天气修复模型,可同时处理混合天气干扰。

Multiple weather images restoration using the task transformer and adaptive mixup strategy

  • 用任务序列生成器让模型自适应关注不同天气特征
  • 采用快速傅里叶卷积扩大感受野,提升大范围修复能力
  • 适合自动驾驶等复杂天气场景下的图像增强应用

当前严重的天气去除技术主要集中在单一任务上,如去雨、去雾和去雪。然而,现实中的天气状况往往由多种天气类型混合而成,自动驾驶场景中天气混合程度尚不明确。在复杂多变的天气条件下,单一天气去除模型难以从严重退化图像中恢复清晰画面。因此,亟需开发能够有效处理混合天气条件的多任务严重天气去除模型,以提升自动驾驶场景下的图像质量。本文提出一种新型多任务严重天气去除模型,可自适应地应对复杂天气条件。该模型引入天气任务序列生成器,使自注意力机制能选择性聚焦于不同天气类型的特征。为解决大面积天气退化修复难题,引入快速傅里叶卷积(FFC)以扩大感受野。此外,提出自适应上采样技术,通过选择性保留相关信息,有效融合天气任务信息与底层图像特征。所提模型在公开数据集上达到了最先进的性能。

原文摘要 · Abstract (English)

The current state-of-the-art in severe weather removal predominantly focuses on single-task applications, such as rain removal, haze removal, and snow removal. However, real-world weather conditions often consist of a mixture of several weather types, and the degree of weather mixing in autonomous driving scenarios remains unknown. In the presence of complex and diverse weather conditions, a single weather removal model often encounters challenges in producing clear images from severe weather images. Therefore, there is a need for the development of multi-task severe weather removal models that can effectively handle mixed weather conditions and improve image quality in autonomous driving scenarios. In this paper, we introduce a novel multi-task severe weather removal model that can effectively handle complex weather conditions in an adaptive manner. Our model incorporates a weather task sequence generator, enabling the self-attention mechanism to selectively focus on features specific to different weather types. To tackle the challenge of repairing large areas of weather degradation, we introduce Fast Fourier Convolution (FFC) to increase the receptive field. Additionally, we propose an adaptive upsampling technique that effectively processes both the weather task information and underlying image features by selectively retaining relevant information. Our proposed model has achieved state-of-the-art performance on the publicly available dataset.

图像修复多任务学习自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。