arXiv:2504.10558cs.CV2025-04被引 1

提出新网络,同时优化图像细节与上下文信息恢复

Enhancing Image Restoration through Learning Context-Rich and Detail-Accurate Features

  • 设计多尺度频域选择模块,兼顾空间与频率域信息
  • 在去噪、超分等任务中超越或媲美顶尖方法
  • 适合需要精细图像重建的计算机视觉应用

图像恢复旨在从退化版本中还原高质量图像,需在空间细节与上下文信息之间取得微妙平衡。现有方法多侧重空间特征,忽视频率变化理解。本文提出一种多尺度设计,协同融合空间与频率域知识,精准恢复关键信息。提出混合尺度频域选择块(HSFSBlock),既捕获空间多尺度特征,又在频域筛选最有效成分。为缓解仅用加法或拼接的跳跃连接引入的噪声,引入跳跃连接注意力机制(SCAM),智能决定传递信息。构建的紧密互联架构称为LCDNet。在多种图像恢复任务上的大量实验表明,该模型性能优于或媲美当前最优算法。

原文摘要 · Abstract (English)

Image restoration involves recovering high-quality images from their corrupted versions, requiring a nuanced balance between spatial details and contextual information. While certain methods address this balance, they predominantly emphasize spatial aspects, neglecting frequency variation comprehension. In this paper, we present a multi-scale design that optimally balances these competing objectives, seamlessly integrating spatial and frequency domain knowledge to selectively recover the most informative information. Specifically, we develop a hybrid scale frequency selection block (HSFSBlock), which not only captures multi-scale information from the spatial domain, but also selects the most informative components for image restoration in the frequency domain. Furthermore, to mitigate the inherent noise introduced by skip connections employing only addition or concatenation, we introduce a skip connection attention mechanism (SCAM) to selectively determines the information that should propagate through skip connections. The resulting tightly interlinked architecture, named as LCDNet. Extensive experiments conducted across diverse image restoration tasks showcase that our model attains performance levels that are either superior or comparable to those of state-of-the-art algorithms.

图像恢复多尺度注意力机制频域

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。