arXiv:2607.04608cs.CV2026-07中稿 · ECCV

用物理模型指导的网络,让无镜头成像更清晰。

Integrated Forward-Inverse Network for Lensless Image Reconstruction

论文配图:Integrated Forward-Inverse Network for Lensless Image Reconstruction
图 1 · 摘自论文原文
  • 正反向交替迭代:每层都结合物理投影与可学习反演。
  • 在新数据集上重建质量领先,抗误差能力更强。
  • 适合做无镜头相机、全息成像等物理建模任务的人看。

无镜头成像通过薄编码元件替代传统光学系统,实现紧凑且多功能的计算相机。然而,由大范围点扩散函数(PSFs)引起的高度混叠观测使逆问题严重病态,对校准误差和模型失配敏感。尽管深度学习方法(包括融合物理先验的混合模型)已展现出潜力,但保持网络层级中的数据保真度仍具挑战。本文提出集成正向-逆向网络(IFIN),一种物理引导的架构,在每个尺度上交替使用可微分正向投影与可学习逆向更新,从而在测量域和图像域联合利用互补信息。这种双向耦合支持逐步、物理一致的优化,并可在模型不确定性下实现系统约束的PSF核自适应。在具有挑战性的无镜头基准测试中(包括一个新引入的数据集),IFIN达到当前最优重建效果。此外,其在高斯去模糊和模拟共轭全息重建任务中也表现优异,表明该交错原理可拓展至非无镜头场景。

原文摘要 · Abstract (English)

Lensless imaging enables compact and versatile computational cameras by replacing bulky optics with thin coded elements. However, reconstruction from the resulting measurements is challenging: large-footprint point-spread functions (PSFs) produce highly multiplexed observations, making inversion severely ill-conditioned and sensitive to calibration errors and model mismatch. While deep learning approaches, including hybrid models that incorporate physics priors, have shown promise, explicitly maintaining data fidelity throughout the network hierarchy remains difficult. Here, we propose the Integrated Forward-Inverse Network (IFIN), a physics-guided architecture that interleaves differentiable forward projections with learnable inverse updates at every scale, enabling complementary cues to be exploited jointly in the measurement and image domains. This bidirectional coupling supports progressive, physics-consistent refinement and permits system-constrained PSF kernel adaptation under model uncertainty. On challenging lensless benchmarks, including a newly introduced dataset, IFIN achieves state-of-the-art reconstruction quality. We further observe competitive performance on Gaussian deblurring and simulated inline holography reconstruction, suggesting that the same interleaving principle can extend beyond lensless cameras.

无镜头成像物理模型图像重建深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。