基于视觉感知理论,用双U-Net结构分离光照与反射图,提升暗光图像增强稳定性。
WREN: Low Light Image Enhancement Using Retinex theory-based Double U-Net-like Structures

- 双分支U-Net分解图像为反射图与光照图,符合人类视觉原理
- 在多个数据集上达到当前最优性能,对光照变化鲁棒
- 适合需要稳定暗光增强的摄影、监控等场景
本文提出一种基于Retinex理论的低光图像增强神经网络WREN,以提升不同动态范围场景下的增强鲁棒性。该理论将低光图像分解为固有颜色上下文(反射图)和场景依赖光照(光照图)。由于分解不唯一,现有方法常出现过增强且对光照变化敏感。为此,WREN采用双U-Net结构:第一网络通过一个编码器和两个解码器完成图像分解;第二网络在编码器与解码器间引入定制Transformer模块,仅增强第一阶段获得的光照图,严格遵循Retinex假设。最终将增强后的光照图与反射图融合。模型端到端训练,使用尺度不变损失函数,对光照缩放具有强鲁棒性。实验表明,本方法在多个数据集上均达到领先性能。代码已公开。
原文摘要 · Abstract (English)
This paper proposes a neural network for low light image enhancement (LLIE) based on retinex theory to make LLIE robust for various dynamic range scenes. The retinex theory is an image formulation model inspired by a human color perception hypothesis, where a low light image is decomposed into intrinsic color context (i.e., reflectance map) and scene-dependent illumination (i.e., illumination map). Due to non-uniqueness of its decomposition, existing retinex-based LLIE methods often fail to achieve stable decomposition, which lead to over-enhancement. Typically, they are sensitive to the dynamic ranges that vary in different lighting conditions. To tackle this issue, we propose WREN: An LLIE neural network with double U-Net-like structures. WREN consists of two U-Net-like sub-networks. The first network has one encoder and two decoders that decompose an input image into the reflectance and illumination maps. The second network with a customized Transformer block between an encoder and a decoder only enhances the illumination map obtained from the first network: This completely follows the assumption of the retinex theory. Finally, the enhanced illumination map is recombined with the reflectance map. The network is trained end-to-end with a scale-invariant loss function, which gives robustness against the illumination scaling. Numerical results show that our method achieves the state-of-the-art performance across multiple datasets. Our code is available online.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。