统一处理多种恶劣天气图像退化,提升真实场景恢复效果。
TANet: Triplet Attention Network for All-In-One Adverse Weather Image Restoration
- 设计三重注意力模块,融合局部、全局条带与分布注意力。
- 在多个数据集上实现领先性能,显著优于单一天气模型。
- 适合需要泛化处理复杂多变天气的视觉系统开发者。
恶劣天气图像修复旨在消除由雾霾、雨雪等气象条件引起的模糊、遮挡、色彩失真和对比度下降等问题。现有方法在单一天气条件下表现良好,但在真实世界中频繁出现的不可预测天气下性能下降。尽管不同天气退化模式各异,但普遍存在遮挡、色彩偏移和对比度衰减等共性特征。为此,本文提出一种统一的三重注意力网络(TANet),通过局部像素注意力(LPA)和全局条带注意力(GSA)缓解非均匀退化导致的遮挡,利用全局分布注意力(GDA)校正大气散射引发的色彩失真与对比度降低。TANet充分挖掘多天气间的共性知识,在无需更换模型的情况下有效应对多种恶劣天气。实验表明,TANet在所有一体化天气图像修复任务中均达到当前最优水平。代码已开源:https://github.com/xhuachris/TANet-ACCV-2024。
原文摘要 · Abstract (English)
Adverse weather image restoration aims to remove unwanted degraded artifacts, such as haze, rain, and snow, caused by adverse weather conditions. Existing methods achieve remarkable results for addressing single-weather conditions. However, they face challenges when encountering unpredictable weather conditions, which often happen in real-world scenarios. Although different weather conditions exhibit different degradation patterns, they share common characteristics that are highly related and complementary, such as occlusions caused by degradation patterns, color distortion, and contrast attenuation due to the scattering of atmospheric particles. Therefore, we focus on leveraging common knowledge across multiple weather conditions to restore images in a unified manner. In this paper, we propose a Triplet Attention Network (TANet) to efficiently and effectively address all-in-one adverse weather image restoration. TANet consists of Triplet Attention Block (TAB) that incorporates three types of attention mechanisms: Local Pixel-wise Attention (LPA) and Global Strip-wise Attention (GSA) to address occlusions caused by non-uniform degradation patterns, and Global Distribution Attention (GDA) to address color distortion and contrast attenuation caused by atmospheric phenomena. By leveraging common knowledge shared across different weather conditions, TANet successfully addresses multiple weather conditions in a unified manner. Experimental results show that TANet efficiently and effectively achieves state-of-the-art performance in all-in-one adverse weather image restoration. The source code is available at https://github.com/xhuachris/TANet-ACCV-2024.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。