针对低光图像增强难题,提出新数据集与条件扩散模型。
Super-resolving Real-world Image Illumination Enhancement: A New Dataset and A Conditional Diffusion Model
- 基于真实低光拍摄构建4800对图像数据集
- 在-6 EV至0 EV曝光下保留结构与细节,显著提升清晰度
- 适合低光成像、图像恢复研究者使用
现有超分辨率方法和数据集多针对光照充足场景设计,难以应对真实低光环境下的图像退化问题。为此,本文提出SRRIIE数据集,包含4800对低/高画质图像,通过ILDC相机与光学变焦镜头,在-6 EV至0 EV曝光范围、ISO 50至12800范围内采集真实低光图像。为解决复杂噪声下结构与锐度保持困难的问题,我们改进原始传感器数据的条件输入,并提出一种新型时间融合条件扩散模型。在多个真实世界基准数据集上的定量与定性实验表明,该方法在保留图像结构和细节方面具有显著优势。代码与数据集将开源于https://github.com/Yaofang-Liu/Super-Resolving。
原文摘要 · Abstract (English)
Most existing super-resolution methods and datasets have been developed to improve the image quality in well-lighted conditions. However, these methods do not work well in real-world low-light conditions as the images captured in such conditions lose most important information and contain significant unknown noises. To solve this problem, we propose a SRRIIE dataset with an efficient conditional diffusion probabilistic models-based method. The proposed dataset contains 4800 paired low-high quality images. To ensure that the dataset are able to model the real-world image degradation in low-illumination environments, we capture images using an ILDC camera and an optical zoom lens with exposure levels ranging from -6 EV to 0 EV and ISO levels ranging from 50 to 12800. We comprehensively evaluate with various reconstruction and perceptual metrics and demonstrate the practicabilities of the SRRIIE dataset for deep learning-based methods. We show that most existing methods are less effective in preserving the structures and sharpness of restored images from complicated noises. To overcome this problem, we revise the condition for Raw sensor data and propose a novel time-melding condition for diffusion probabilistic model. Comprehensive quantitative and qualitative experimental results on the real-world benchmark datasets demonstrate the feasibility and effectivenesses of the proposed conditional diffusion probabilistic model on Raw sensor data. Code and dataset will be available at https://github.com/Yaofang-Liu/Super-Resolving
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。