arXiv:2409.07040cs.CVeess.IV2024-09被引 20

用Mamba模型联合去马赛克与降噪,提升低光RAW图像质量。

Retinex-RAWMamba: Bridging Demosaicing and Denoising for Low-Light RAW Image Enhancement

  • 基于Mamba架构设计端到端网络,适配不同色彩滤波阵列的RAW图像。
  • 在SID和MCR数据集上超越现有方法,实现更优的跨域映射效果。
  • 引入Retinex分解模块,自动校正曝光并抑制噪声,减少人工干预。

低光图像增强,尤其是从RAW域到sRGB域的跨域映射,仍是重大挑战。现有深度学习方法虽取得进展,但单阶段方法因统一复杂映射导致降噪性能受限;而两阶段方法常忽略图像信号处理(ISP)流水线中的去马赛克特性,尤其在低光下易引发色彩失真。为此,我们提出一种专为低光RAW图像设计的Mamba-based方法——RAWMamba,可有效处理不同色彩滤波阵列(CFA)的原始图像。进一步引入基于Retinex先验的去马赛克分解模块(RDM),将光照与反射分离,实现更有效的降噪与自动非线性曝光校正,降低对人工线性光照增强的依赖。通过融合去马赛克与降噪流程,显著提升低光RAW图像增强效果。在公开数据集SID和MCR上的实验表明,所提RAWMamba在跨域映射任务中达到当前最优性能。代码已开源:https://github.com/Cynicarlos/RetinexRawMamba。

原文摘要 · Abstract (English)

Low-light image enhancement, particularly in cross-domain tasks such as mapping from the raw domain to the sRGB domain, remains a significant challenge. Many deep learning-based methods have been developed to address this issue and have shown promising results in recent years. However, single-stage methods, which attempt to unify the complex mapping across both domains, leading to limited denoising performance. In contrast, existing two-stage approaches typically overlook the characteristic of demosaicing within the Image Signal Processing (ISP) pipeline, leading to color distortions under varying lighting conditions, especially in low-light scenarios. To address these issues, we propose a novel Mamba-based method customized for low light RAW images, called RAWMamba, to effectively handle raw images with different CFAs. Furthermore, we introduce a Retinex Decomposition Module (RDM) grounded in Retinex prior, which decouples illumination from reflectance to facilitate more effective denoising and automatic non-linear exposure correction, reducing the effect of manual linear illumination enhancement. By bridging demosaicing and denoising, better enhancement for low light RAW images is achieved. Experimental evaluations conducted on public datasets SID and MCR demonstrate that our proposed RAWMamba achieves state-of-the-art performance on cross-domain mapping. The code is available at https://github.com/Cynicarlos/RetinexRawMamba.

图像增强RAW图像MambaRetinex

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。