X-Restormer++通过双阶段训练与融合,实现全天候图像修复的顶尖效果。
X-Restormer++: 1st Place Solution for the UG2+ CVPR 2026 All-Weather Restoration Challenge

- 基于双注意力结构,结合自适应输入缩放提升多退化场景建模能力。
- 在800GB大规模数据上预训练,再用小样本微调,实现高效域适配。
- 提出梯度引导边缘感知损失,更好保留细节,适合图像修复研究者参考。
本文介绍我们在CVPR 2026 UG2+挑战赛第1赛道(全天候图像修复)中的获胜方案。方法基于X-Restormer,通过多卷积头转置注意力与重叠交叉注意力捕捉通道级全局依赖与空间局部结构,并引入Restormer-Plus的空间自适应输入缩放机制。采用两阶段训练策略:第一阶段,模型B从零开始在约800GB的FoundIR数据子集上训练,覆盖模糊、雾霾、雨、雪及复合退化(如雨雾共现)五类;第二阶段,模型A在WeatherStream数据集(雨/雪子集)上微调,以模型B最终检查点为初始化,实现高效域适应。为更好保留结构细节,提出梯度引导边缘感知(GGEA)损失,利用Sobel算子生成空间自适应权重图,强化对边缘与高频区域的监督,与L1和多尺度SSIM损失联合优化。推理时,采用加权平均融合:out = 0.4 × outA + 0.6 × outB,权重更高分配给具备更强泛化能力的模型B。该方案成功获得第一名。
原文摘要 · Abstract (English)
In this work, we present our winning solution for the 8th UG2+ Challenge (CVPR 2026) Track 1: Image Restoration under All-weather Conditions. Our method is built upon the X-Restormer baseline, which captures both channel-wise global dependencies and spatially-local structural information through its dual-attention design (Multi-DConv Head Transposed Attention and Overlapping Cross-Attention), augmented with the spatially-adaptive input scaling mechanism from Restormer-Plus. We adopt a two-stage training strategy with dual-model ensemble inference. In the first stage, Model B is trained from scratch on a large-scale diverse dataset randomly sampled from the FoundIR training set (approximately 800 GB out of 4.84 TB), covering five degradation types: blur, haze, rain, snow, and composite conditions such as co-occurring rain and haze. In the second stage, Model A is fine-tuned on the WeatherStream dataset (rain and snow splits) using Model B's final checkpoint as pretrained initialization, enabling efficient domain adaptation with a substantially smaller dataset. To better preserve structural details during training, we propose a novel Gradient-Guided Edge-Aware (GGEA) Loss, which applies Sobel operators to the ground-truth image to construct a spatially adaptive weight map that assigns higher supervision to edge and high-frequency regions. This is incorporated alongside L1 and Multi-Scale SSIM losses in a unified training objective. At inference time, predictions from the two models are fused via a weighted average, out = 0.4 x outA + 0.6 x outB, where the higher weight assigned to Model B reflects its stronger generalization ability from large-scale pretraining. With these strategies, our proposed method successfully ranks 1st in the challenge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。