提出UnfoldIR网络,提升光照退化图像修复效果。
UnfoldIR: Rethinking Deep Unfolding Network in Illumination Degradation Image Restoration
- 设计多阶段网络,融合光照校正与反射率增强模块。
- 引入频域感知结构,改善严重退化区域的细节恢复。
- 适合图像修复、低光照增强等任务,尤其在无监督场景表现佳。
深度展开网络(DUNs)广泛用于光照退化图像修复(IDIR),结合模型驱动方法的可解释性与学习方法的泛化能力。然而,现有DUN方法性能仍显著落后于顶尖IDIR求解器。研究发现,问题并非源于DUN结构缺陷,而是对展开结构的探索不足,包括:(1) 构建任务专用修复模型,(2) 融合先进网络架构,(3) 设计专用于DUN的损失函数。为此,本文提出新型DUN方法UnfoldIR。首先构建含专用正则项的IDIR模型,以平滑光照并增强纹理;将其迭代优化解展开为多阶段网络,每阶段包含反射率辅助光照校正(RAIC)模块和光照引导反射率增强(IGRE)模块。RAIC采用视觉状态空间(VSS)提取非局部特征,强化光照平滑性;IGRE引入频域感知VSS,全局对齐相似纹理,使轻微退化区域指导严重退化区域的细节增强,在抑制噪声的同时提升细节。此外,针对多阶段结构,提出跨阶段信息一致性损失,维持后期网络稳定性,促进结构保持,并在无监督设置下持续提升性能。实验验证其在5个IDIR任务和3个下游问题上的有效性。
原文摘要 · Abstract (English)
Deep unfolding networks (DUNs) are widely employed in illumination degradation image restoration (IDIR) to merge the interpretability of model-based approaches with the generalization of learning-based methods. However, the performance of DUN-based methods remains considerably inferior to that of state-of-the-art IDIR solvers. Our investigation indicates that this limitation does not stem from structural shortcomings of DUNs but rather from the limited exploration of the unfolding structure, particularly for (1) constructing task-specific restoration models, (2) integrating advanced network architectures, and (3) designing DUN-specific loss functions. To address these issues, we propose a novel DUN-based method, UnfoldIR, for IDIR tasks. UnfoldIR first introduces a new IDIR model with dedicated regularization terms for smoothing illumination and enhancing texture. We unfold the iterative optimized solution of this model into a multistage network, with each stage comprising a reflectance-assisted illumination correction (RAIC) module and an illumination-guided reflectance enhancement (IGRE) module. RAIC employs a visual state space (VSS) to extract non-local features, enforcing illumination smoothness, while IGRE introduces a frequency-aware VSS to globally align similar textures, enabling mildly degraded regions to guide the enhancement of details in more severely degraded areas. This suppresses noise while enhancing details. Furthermore, given the multistage structure, we propose an inter-stage information consistent loss to maintain network stability in the final stages. This loss contributes to structural preservation and sustains the model's performance even in unsupervised settings. Experiments verify our effectiveness across 5 IDIR tasks and 3 downstream problems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。