arXiv:2411.13961cs.CV2024-11

用频域先验引导扩散模型,零样本增强暗光图像

Zero-Shot Low-Light Image Enhancement via Joint Frequency Domain Priors Guided Diffusion

  • 融合小波与傅里叶频域信息构建光照先验
  • 在多种暗光场景下实现稳定增强效果
  • 适合无配对数据的暗光图像修复任务

由于真实世界成对数据集的稀缺性及低光环境的复杂性,监督方法难以具备良好的场景泛化能力。同时,受限于光照和内容引导不足,现有零样本方法难以应对未知严重退化问题。为此,本文提出一种新的零样本低光增强方法,通过有效结合小波与傅里叶频域,构建丰富的先验信息,在扩散采样过程中补偿光照与结构信息缺失。其核心思路源于小波与傅里叶频域的相似性:光照与结构信息分别对应特定频域区域。通过将扩散过程转移至小波低频域,并在逆向过程中持续分解融合小波与傅里叶频域,构建出丰富的照明先验,以指导图像生成与增强。大量实验表明,该框架在多种场景下均具有鲁棒性和有效性。

原文摘要 · Abstract (English)

Due to the singularity of real-world paired datasets and the complexity of low-light environments, this leads to supervised methods lacking a degree of scene generalisation. Meanwhile, limited by poor lighting and content guidance, existing zero-shot methods cannot handle unknown severe degradation well. To address this problem, we will propose a new zero-shot low-light enhancement method to compensate for the lack of light and structural information in the diffusion sampling process by effectively combining the wavelet and Fourier frequency domains to construct rich a priori information. The key to the inspiration comes from the similarity between the wavelet and Fourier frequency domains: both light and structure information are closely related to specific frequency domain regions, respectively. Therefore, by transferring the diffusion process to the wavelet low-frequency domain and combining the wavelet and Fourier frequency domains by continuously decomposing them in the inverse process, the constructed rich illumination prior is utilised to guide the image generation enhancement process. Sufficient experiments show that the framework is robust and effective in various scenarios. The code will be available at: \href{https://github.com/hejh8/Joint-Wavelet-and-Fourier-priors-guided-diffusion}{https://github.com/hejh8/Joint-Wavelet-and-Fourier-priors-guided-diffusion}.

低光增强扩散模型频域先验

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。