arXiv:2503.00642cs.CVeess.IV2025-03被引 11

无需配对图像,通过自监督与自条件策略实现低光图像增强。

Self-supervision via Controlled Transformation and Unpaired Self-conditioning for Low-light Image Enhancement

  • 基于可控变换与自条件机制,从无配对数据中学习增强程度。
  • 在多个标准数据集上超越现有方法,定量与主观评价均更优。
  • 适合需要少标注、高泛化能力的低光图像处理场景。

真实世界中成像设备捕获的低光图像普遍存在可视性差的问题,需特定领域增强以还原细节且无伪影。本文提出一种无配对的低光图像增强网络,结合新颖的受控变换自监督与无配对自条件策略。模型可自主判断输入图像各像素所需的增强程度,该信息由无配对的低光与正常光照图像中隐含学习得到。自监督基于对输入图像的可控变换,并确保变换后仍保持增强效果;自条件则使模型在无配对图像上训练,避免对已增强或正常光照图像进行过度增强。通过在细节保留前提下抑制低梯度区域噪声,并防止对无噪声的正常光照图像进行去噪,有效处理输入图像中的固有噪声。基于针对低光增强特性的训练策略,模型在不依赖配对监督的情况下仍保持较高性能。大量实验表明,本方法在多个标准数据集上普遍优于当前最优方法,定性和定量评估均表现优异。消融实验证明了自监督与自条件策略及其相关损失函数的有效性。

原文摘要 · Abstract (English)

Real-world low-light images captured by imaging devices suffer from poor visibility and require a domain-specific enhancement to produce artifact-free outputs that reveal details. In this paper, we propose an unpaired low-light image enhancement network leveraging novel controlled transformation-based self-supervision and unpaired self-conditioning strategies. The model determines the required degrees of enhancement at the input image pixels, which are learned from the unpaired low-lit and well-lit images without any direct supervision. The self-supervision is based on a controlled transformation of the input image and subsequent maintenance of its enhancement in spite of the transformation. The self-conditioning performs training of the model on unpaired images such that it does not enhance an already-enhanced image or a well-lit input image. The inherent noise in the input low-light images is handled by employing low gradient magnitude suppression in a detail-preserving manner. In addition, our noise handling is self-conditioned by preventing the denoising of noise-free well-lit images. The training based on low-light image enhancement-specific attributes allows our model to avoid paired supervision without compromising significantly in performance. While our proposed self-supervision aids consistent enhancement, our novel self-conditioning facilitates adequate enhancement. Extensive experiments on multiple standard datasets demonstrate that our model, in general, outperforms the state-of-the-art both quantitatively and subjectively. Ablation studies show the effectiveness of our self-supervision and self-conditioning strategies, and the related loss functions.

低光增强自监督无配对训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。