arXiv:2501.03511eess.IV2025-01被引 13

用物理模型与生成模型结合,提升低光下的无镜头成像质量。

A generative approach for lensless imaging in low-light conditions

论文配图:A generative approach for lensless imaging in low-light conditions
图 1 · 摘自论文原文
  • 先用物理模型重建初步图像,再用生成模型去噪。
  • 在真实和模拟数据上显著提升图像清晰度。
  • 适合低光环境、空间受限场景的成像应用。

无镜头成像因其轻量化和紧凑性,适用于空间受限环境。然而,缺乏聚焦镜头且光照不足导致测量受复杂噪声干扰,因光子捕获不足。本文提出一种鲁棒的重建方法,在低光条件下实现高质量成像,结合模型驱动与数据驱动双视角:首先利用物理模型驱动方法,在测量模型伪逆的值域内进行重建,作为噪声测量中的信息提取初筛;随后引入生成模型驱动视角,抑制初始结果中的残余噪声。具体地,通过可学习维纳滤波模块生成初始噪声重建图像;为实现从噪声版本快速且稳定地生成清晰图像,采用改进的条件生成扩散模块,将原始图像转换至小波域以提高效率,并使用改进的双向训练策略增强稳定性。仿真与真实实验均表明,整体视觉质量显著提升,推动了复杂低光环境下无镜头成像的发展。

原文摘要 · Abstract (English)

Lensless imaging offers a lightweight, compact alternative to traditional lens-based systems, ideal for exploration in space-constrained environments. However, the absence of a focusing lens and limited lighting in such environments often result in low-light conditions, where the measurements suffer from complex noise interference due to insufficient capture of photons. This study presents a robust reconstruction method for high-quality imaging in low-light scenarios, employing two complementary perspectives: model-driven and data-driven. First, we apply a physic-model-driven perspective to reconstruct in the range space of the pseudo-inverse of the measurement model as a first guidance to extract information in the noisy measurements. Then, we integrate a generative-model based perspective to suppress residual noises as the second guidance to suppress noises in the initial noisy results. Specifically, a learnable Wiener filter-based module generates an initial noisy reconstruction. Then, for fast and, more importantly, stable generation of the clear image from the noisy version, we implement a modified conditional generative diffusion module. This module converts the raw image into the latent wavelet domain for efficiency and uses modified bidirectional training processes for stabilization. Simulations and real-world experiments demonstrate substantial improvements in overall visual quality, advancing lensless imaging in challenging low-light environments.

无镜头成像低光成像生成模型扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。