arXiv:2512.10581cs.CV2025-12被引 2

对称U-Net可有效挖掘退化特征,实现更简单强大的图像修复基线。

Unleashing Degradation-Carrying Features in Symmetric U-Net: Simpler and Stronger Baselines for All-in-One Image Restoration

  • 采用对称U-Net设计,通过尺度对齐与跨尺度传播保留退化信号。
  • 在多个基准数据集上优于现有方法,且计算开销更低。
  • 适合追求高效、高性能图像修复的开发者和研究者。

全场景图像修复旨在统一处理噪声、模糊、恶劣天气等多种退化问题,但现有方法趋向于使用复杂架构(如专家混合模型、扩散模型)和繁琐的退化提示策略。本文揭示关键洞察:精心设计的特征提取本身已蕴含退化信息,对称U-Net即可有效释放这些线索。通过对编码器-解码器特征尺度对齐并简化跨尺度传播,该设计稳健保留内在退化信号,使跳接路径中简单的加法融合即可达到顶尖性能。主基线模型SymUNet基于此对称结构,在多个基准数据集上超越现有方法,同时降低计算成本。进一步提出语义增强变体SE-SymUNet,通过冻结的CLIP特征直接注入语义信息,利用简单交叉注意力显式强化退化先验。大量实验证明所提方法的优越性。两者均建立更简洁、更强的全场景图像修复基线。源代码见https://github.com/WenlongJiao/SymUNet。

原文摘要 · Abstract (English)

All-in-one image restoration aims to handle diverse degradations (e.g., noise, blur, adverse weather) within a unified framework, yet existing methods increasingly rely on complex architectures (e.g., Mixture-of-Experts, diffusion models) and elaborate degradation prompt strategies. In this work, we reveal a critical insight: well-crafted feature extraction inherently encodes degradation-carrying information, and a symmetric U-Net architecture is sufficient to unleash these cues effectively. By aligning feature scales across encoder-decoder and enabling streamlined cross-scale propagation, our symmetric design preserves intrinsic degradation signals robustly, rendering simple additive fusion in skip connections sufficient for state-of-the-art performance. Our primary baseline, SymUNet, is built on this symmetric U-Net and achieves better results across benchmark datasets than existing approaches while reducing computational cost. We further propose a semantic enhanced variant, SE-SymUNet, which integrates direct semantic injection from frozen CLIP features via simple cross-attention to explicitly amplify degradation priors. Extensive experiments on several benchmarks validate the superiority of our methods. Both baselines SymUNet and SE-SymUNet establish simpler and stronger foundations for future advancements in all-in-one image restoration. The source code is available at https://github.com/WenlongJiao/SymUNet.

图像修复对称结构特征挖掘基线模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。