arXiv:2504.12204cs.CVcs.MM2025-04被引 2

用逆向ISP生成真实低光图像数据,提升增强模型效果

Towards Realistic Low-Light Image Enhancement via ISP Driven Data Modeling

  • 通过逆ISP将正常光照图转为RAW域,再在该域合成低光退化
  • 生成的训练数据覆盖多种退化模式,使模型在多个数据集上超越顶尖方法
  • 适合需要真实感低光增强的视觉系统研发者使用

深度神经网络(DNN)已成为低光图像增强(LLIE)的主流方法。然而,实际应用中仍存在噪声放大、白平衡错误或增强结果不自然等问题。核心挑战在于缺乏多样且大规模的真实低光数据,无法覆盖复杂成像流程。本文提出一种基于图像信号处理(ISP)的数据生成流水线,可无限生成成对训练数据。首先将易获取的高质量正常光照图像通过反向ISP还原为RAW格式,在此域直接合成低光退化。随后经一系列可控变化的ISP流程(包括白平衡调整、色彩空间转换、色调映射和伽马校正),扩大退化空间,提升数据多样性。实验采用仅含卷积层、组归一化、GeLU激活及卷积块注意力模块(CBAM)的简单UNet模型,在多个数据集上验证,其在量化与视觉评估上均优于现有先进方法。

原文摘要 · Abstract (English)

Deep neural networks (DNNs) have recently become the leading method for low-light image enhancement (LLIE). However, despite significant progress, their outputs may still exhibit issues such as amplified noise, incorrect white balance, or unnatural enhancements when deployed in real world applications. A key challenge is the lack of diverse, large scale training data that captures the complexities of low-light conditions and imaging pipelines. In this paper, we propose a novel image signal processing (ISP) driven data synthesis pipeline that addresses these challenges by generating unlimited paired training data. Specifically, our pipeline begins with easily collected high-quality normal-light images, which are first unprocessed into the RAW format using a reverse ISP. We then synthesize low-light degradations directly in the RAW domain. The resulting data is subsequently processed through a series of ISP stages, including white balance adjustment, color space conversion, tone mapping, and gamma correction, with controlled variations introduced at each stage. This broadens the degradation space and enhances the diversity of the training data, enabling the generated data to capture a wide range of degradations and the complexities inherent in the ISP pipeline. To demonstrate the effectiveness of our synthetic pipeline, we conduct extensive experiments using a vanilla UNet model consisting solely of convolutional layers, group normalization, GeLU activation, and convolutional block attention modules (CBAMs). Extensive testing across multiple datasets reveals that the vanilla UNet model trained with our data synthesis pipeline delivers high fidelity, visually appealing enhancement results, surpassing state-of-the-art (SOTA) methods both quantitatively and qualitatively.

低光增强ISP建模数据合成图像修复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。