arXiv:2609.02434cs.CV2026-09

用不确定性引导的门控变换器提升恶劣天气图像恢复效果

Uncertainty-Guided Adverse Weather Restoration via Gated Transformer Network

论文配图:Uncertainty-Guided Adverse Weather Restoration via Gated Transformer Network
图 1 · 摘自论文原文
  • 引入门控双尺度变换块,融合全局与局部特征
  • 在多个基准上达到领先性能,显著改善细节恢复
  • 适合需要高精度图像修复的自动驾驶与遥感应用

恶劣天气图像恢复因退化空间异质性而面临挑战。现有天气特定恢复模型依赖于与天气无关的全局聚合、简单的跨尺度融合和确定性目标,在全场景恶劣天气设置下表现不佳。为此,本文提出不确定性引导的恶劣天气恢复网络(UAR-Net),一个面向天气特定的全场景框架,结合门控变换器与平衡多尺度跳跃连接。具体地,采用门控双尺度变换块(GDTB)联合建模选择性全局交互与多尺度局部结构,通过渐进式平衡多尺度跳跃连接(BMSC)实现均衡的多尺度特征融合,并设计不确定性感知精修头(URH)完成去伪影、细节增强及预测不确定性估计。模型使用亮度感知能量损失(BAE-Loss)进行监督,以促进准确重建与校准的不确定性。大量实验表明,该方法在多个恶劣天气基准上均达到最优性能。代码将在接受后开源。

原文摘要 · Abstract (English)

Restoring images degraded by adverse weather remains challenging due to spatially heterogeneous degradations. Many existing weather-specific restoration models rely on weather-agnostic global aggregation, naive cross-scale fusion, and deterministic objectives, which struggle to handle heterogeneous degradations in all-in-one adverse-weather settings. To address these limitations, we propose an Uncertainty-guided Adverse-weather Restoration Network (UAR-Net), a weather-specific AiO framework that integrates a gated transformer with balanced multi-scale skip connections. Specifically, we employ Gated Dual-scale Transformer Blocks (GDTB) to jointly model selective global interactions and multi-scale local structures, a progressive Balanced Multi-scale Skip Connection (BMSC) for balanced multi-scale feature integration, and an Uncertainty-Aware Refinement Head (URH) that performs artifact removal, detail enhancement, and predictive uncertainty estimation. The model is supervised by a Brightness-Aware Energy Loss (BAE-Loss) to encourage accurate reconstruction with well-calibrated uncertainty. Extensive experiments demonstrate that our method achieves state-of-the-art performance across multiple adverse-weather benchmarks. The codes will open source upon acceptance.

图像恢复门控变换器不确定性建模恶劣天气

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。