arXiv:2502.01102eess.IVcs.CV2025-02被引 11

提出模块化重建方法,提升无透镜成像的鲁棒性与跨掩码泛化能力。

Towards Robust and Generalizable Lensless Imaging with Modular Learned Reconstruction

  • 设计预处理模块,解决传统图像恢复方法在无透镜成像中的局限性。
  • 在多种掩码类型上验证重建效果,实现跨系统泛化性能提升。
  • 支持迁移学习,减少新系统部署所需测量与训练时间。

无透镜相机摒弃了类人眼成像的传统设计,以薄掩膜替代镜头,并将成像过程移至数字后处理阶段。当前最先进的无透镜成像技术采用融合物理建模与神经网络的端到端学习方法,但通常依赖简化建模假设以降低校准与计算复杂度。此外,现有方法在面对新型掩膜时的泛化能力尚未被系统研究。为此,本文提出一种模块化学习重建框架,其核心是一个图像恢复前的预处理组件。理论分析表明,该预处理对标准恢复技术(如维纳滤波和迭代算法)至关重要;大量实验验证了其在多种无透镜成像方法及不同掩膜类型(振幅与相位型)数据集上的有效性。我们首次构建跨掩膜类型的泛化基准,评估基于某类系统训练的重建模型在其他系统上的表现。该模块化架构支持使用预训练组件与迁移学习,显著减少新系统部署所需的测量与训练周期。作为工作的一部分,我们开源了四个数据集及用于数据采集与模型训练的软件工具。

原文摘要 · Abstract (English)

Lensless cameras disregard the conventional design that imaging should mimic the human eye. This is done by replacing the lens with a thin mask, and moving image formation to the digital post-processing. State-of-the-art lensless imaging techniques use learned approaches that combine physical modeling and neural networks. However, these approaches make simplifying modeling assumptions for ease of calibration and computation. Moreover, the generalizability of learned approaches to lensless measurements of new masks has not been studied. To this end, we utilize a modular learned reconstruction in which a key component is a pre-processor prior to image recovery. We theoretically demonstrate the pre-processor's necessity for standard image recovery techniques (Wiener filtering and iterative algorithms), and through extensive experiments show its effectiveness for multiple lensless imaging approaches and across datasets of different mask types (amplitude and phase). We also perform the first generalization benchmark across mask types to evaluate how well reconstructions trained with one system generalize to others. Our modular reconstruction enables us to use pre-trained components and transfer learning on new systems to cut down weeks of tedious measurements and training. As part of our work, we open-source four datasets, and software for measuring datasets and for training our modular reconstruction.

无透镜成像模块化重建跨掩码泛化迁移学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。