arXiv:2604.06623cs.CV2026-04中稿 · IEEE Transactions …被引 2

一模型搞定雨雪雾天气图像修复,兼顾效果与效率。

WeatherRemover: All-in-one Adverse Weather Removal with Multi-scale Feature Map Compression

  • 采用多尺度金字塔结构+门控机制,自适应选择关键特征。
  • 在多个天气数据集上实现峰值性能,参数量小、推理快。
  • 适合实际部署的轻量化设计,支持复杂天气联合处理。

恶劣天气下拍摄的图像常因雨、雪、雾导致模糊、遮挡和亮度不足,严重影响后续计算机视觉任务。现有方法多针对单一天气,少数多天气模型却存在参数量大、推理慢、内存占用高等问题。本文提出WeatherRemover,基于类似UNet的结构,融合门控机制与多尺度金字塔视觉Transformer。通过卷积神经网络的通道注意力优化特征提取,结合线性空间压缩降低注意力计算开销。门控机制分布在前馈与下采样阶段,有效抑制冗余信息干扰,提升学习效率。该模型在多种天气条件下均实现优异恢复质量,同时保持低参数量、低计算开销和低内存使用,显著优于同类多天气模型,满足实际应用需求。代码已开源。

原文摘要 · Abstract (English)

Photographs taken in adverse weather conditions often suffer from blurriness, occlusion, and low brightness due to interference from rain, snow, and fog. These issues can significantly hinder the performance of subsequent computer vision tasks, making the removal of weather effects a crucial step in image enhancement. Existing methods primarily target specific weather conditions, with only a few capable of handling multiple weather scenarios. However, mainstream approaches often overlook performance considerations, resulting in large parameter sizes, long inference times, and high memory costs. In this study, we introduce the WeatherRemover model, designed to enhance the restoration of images affected by various weather conditions while balancing performance. Our model adopts a UNet-like structure with a gating mechanism and a multi-scale pyramid vision Transformer. It employs channel-wise attention derived from convolutional neural networks to optimize feature extraction, while linear spatial reduction helps curtail the computational demands of attention. The gating mechanisms, strategically placed within the feed-forward and downsampling phases, refine the processing of information by selectively addressing redundancy and mitigating its influence on learning. This approach facilitates the adaptive selection of essential data, ensuring superior restoration and maximizing efficiency. Additionally, our lightweight model achieves an optimal balance between restoration quality, parameter efficiency, computational overhead, and memory usage, distinguishing it from other multi-weather models, thereby meeting practical application demands effectively. The source code is available at https://github.com/RICKand-MORTY/WeatherRemover.

图像修复多天气轻量化Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。