基于Retinex理论的双分支模型,提升超高清图像修复效果
RetinexDual: Retinex-based Dual Nature Approach for Generalized Ultra-High-Definition Image Restoration
- 分两路处理:空间域修正反射率,频域优化光照色彩
- 在去雨、去模糊、去雾和低光增强任务上均超越现有方法
- 适合需要高精度图像修复的研究与工业应用
图像传感技术的进步使超高清图像修复(UHD IR)愈发重要。传统方法如极端下采样或空间到频域转换存在明显缺陷:下采样导致超高清图像不可逆信息丢失;频域分析表明,纯频域方法对空间局部性退化无效,主要因退化局部性丢失。为此,我们提出RetinexDual,一种基于Retinex理论的新型通用超高清图像修复框架。该框架包含两个互补子网络:负责修正反射率的尺度感知maMBA(SAMBA),采用从粗到精机制,克服了mamba的因果建模问题,有效减少伪影并恢复细节;以及在频域运行、利用全局上下文进行精确光照与色彩校正的频率照明适配器(FIA)。在四个超高清图像修复任务——去雨、去模糊、去雾和低光图像增强(LLIE)——上的评估显示,RetinexDual在定性和定量指标上均优于近期方法。消融实验证明,双分支独立设计的重要性及各组件的有效性。
原文摘要 · Abstract (English)
Advancements in image sensing have elevated the importance of Ultra-High-Definition Image Restoration (UHD IR). Traditional methods, such as extreme downsampling or transformation from the spatial to the frequency domain, encounter significant drawbacks: downsampling induces irreversible information loss in UHD images, while our frequency analysis reveals that pure frequency-domain approaches are ineffective for spatially confined image artifacts, primarily due to the loss of degradation locality. To overcome these limitations, we present RetinexDual, a novel Retinex theory-based framework designed for generalized UHD IR tasks. RetinexDual leverages two complementary sub-networks: the Scale-Attentive maMBA (SAMBA) and the Frequency Illumination Adaptor (FIA). SAMBA, responsible for correcting the reflectance component, utilizes a coarse-to-fine mechanism to overcome the causal modeling of mamba, which effectively reduces artifacts and restores intricate details. On the other hand, FIA ensures precise correction of color and illumination distortions by operating in the frequency domain and leveraging the global context provided by it. Evaluating RetinexDual on four UHD IR tasks, namely deraining, deblurring, dehazing, and Low-Light Image Enhancement (LLIE), shows that it outperforms recent methods qualitatively and quantitatively. Ablation studies demonstrate the importance of employing distinct designs for each branch in RetinexDual, as well as the effectiveness of its various components.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。