arXiv:2505.01755eess.IVcs.CV2025-05IJCAI被引 15

LensNet用深度学习动态建模光学点扩散函数,实现无镜头成像的高保真重建。

LensNet: An End-to-End Learning Framework for Empirical Point Spread Function Modeling and Lensless Imaging Reconstruction

  • 端到端框架融合空域与频域信息,通过可学习编码掩膜模拟器动态估计点扩散函数。
  • 在噪声抑制和高频细节保留上优于现有方法,重构质量显著提升。
  • 适合微型传感器、医疗诊断等对紧凑性和精度要求高的场景。

无镜头成像作为一种有前景的替代方案,在超紧凑结构和低成本架构中尤为突出。然而,其性能受限于点扩散函数(PSF),该函数决定了点光源对最终捕获信号的贡献。传统方法依赖静态或近似PSF模型,需大量预标定与手工处理,难以适应噪声、系统误差和动态场景变化,影响重建质量。本文提出LensNet,一种统一空域与频域表示的端到端深度学习框架。核心是可学习的编码掩膜模拟器(CMS),可在训练中动态数据驱动地估计PSF,克服固定或稀疏校准核的局限。通过嵌入维纳滤波组件,有效恢复全局结构与微细特征,减少对手工预处理步骤的依赖。大量实验表明,相比先进方法,LensNet在噪声抑制和高频细节保留方面表现更优,具备更强鲁棒性与重建精度。该框架实现了物理建模与数据驱动学习的融合,为微型传感器至医学诊断等应用提供了更精准、灵活且实用的无镜头成像解决方案。代码链接:https://github.com/baijiesong/Lensnet。

原文摘要 · Abstract (English)

Lensless imaging stands out as a promising alternative to conventional lens-based systems, particularly in scenarios demanding ultracompact form factors and cost-effective architectures. However, such systems are fundamentally governed by the Point Spread Function (PSF), which dictates how a point source contributes to the final captured signal. Traditional lensless techniques often require explicit calibrations and extensive pre-processing, relying on static or approximate PSF models. These rigid strategies can result in limited adaptability to real-world challenges, including noise, system imperfections, and dynamic scene variations, thus impeding high-fidelity reconstruction. In this paper, we propose LensNet, an end-to-end deep learning framework that integrates spatial-domain and frequency-domain representations in a unified pipeline. Central to our approach is a learnable Coded Mask Simulator (CMS) that enables dynamic, data-driven estimation of the PSF during training, effectively mitigating the shortcomings of fixed or sparsely calibrated kernels. By embedding a Wiener filtering component, LensNet refines global structure and restores fine-scale details, thus alleviating the dependency on multiple handcrafted pre-processing steps. Extensive experiments demonstrate LensNet's robust performance and superior reconstruction quality compared to state-of-the-art methods, particularly in preserving high-frequency details and attenuating noise. The proposed framework establishes a novel convergence between physics-based modeling and data-driven learning, paving the way for more accurate, flexible, and practical lensless imaging solutions for applications ranging from miniature sensors to medical diagnostics. The link of code is https://github.com/baijiesong/Lensnet.

无镜头成像深度学习点扩散函数图像重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。