小传感器镜头式成像新方法,提升大视场清晰度
Large-field-of-view lensless imaging with miniaturized sensors
- 分块学习局部点扩散函数,逐级融合全局上下文
- 传感器缩小至原面积8%时,PSNR提升2dB,SSIM提高5%
- 适合微型成像系统,尤其对边缘区域重建有显著优化
镜头式相机用薄调制掩模替代传统光学元件,实现紧凑成像。但现有方法依赖理想化的全局平移不变点扩散函数(PSF)模型,且假设传感器足够大。实际中PSF随视场空间变化,有限传感器边界会截断调制光,随着传感器缩小,边缘重建质量下降,有效视场受限。本文提出基于局部平移不变卷积模型的局部到全局层级框架,显式建模PSF变化与传感器截断。先分块自适应估计局部PSF并独立重建;再通过层级增强网络逐步扩展感受野,融合局部细节与全局上下文。在公开数据集上,本方法在更小传感器下实现更大有效视场和更优重建质量。极端微型化条件下(传感器缩至原面积8%),PSNR提升2 dB,SSIM提升5%,结构保真度显著改善。代码已开源。
原文摘要 · Abstract (English)
Lensless cameras replace bulky optics with thin modulation masks, enabling compact imaging systems. However, existing methods rely on an idealized model that assumes a globally shift-invariant point spread function (PSF) and sufficiently large sensors. In reality, the PSF varies spatially across the field of view (FOV), and finite sensor boundaries truncate modulated light--effects that intensify as sensors shrink, degrading peripheral reconstruction quality and limiting the effective FOV. We address these limitations through a local-to-global hierarchical framework grounded in a locally shift-invariant convolution model that explicitly accounts for PSF variation and sensor truncation. Patch-wise learned deconvolution first adaptively estimates local PSFs and reconstructs regions independently. A hierarchical enhancement network then progressively expands its receptive field--from small patches through intermediate blocks to the full image--integrating fine local details with global contextual information. Experiments on public datasets show that our method achieves superior reconstruction quality over a larger effective FOV with significantly reduced sensor sizes. Under extreme miniaturization--sensors reduced to 8% of the original area--we achieve improvements of 2 dB (PSNR) and 5% (SSIM), with particularly notable gains in structural fidelity. Code is available at https://github.com/KB504-public/l2g_lensless_imaging .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。