arXiv:2409.18223eess.IVcs.CV2024-09被引 2

基于物理先验的神经表示,提升显微成像分辨率与细节还原能力

PNR: Physics-informed Neural Representation for high-resolution LFM reconstruction

  • 引入物理驱动的神经表征,显式建模光学畸变并优化泽尼克多项式参数
  • 在高频率细节恢复上表现优异,PSNR提升6.1 dB,LPIPS降低超50%
  • 无需大量标注数据,适合长期生物成像等复杂场景应用

光场显微镜(LFM)因其高效捕捉高分辨率三维场景的能力,在多个领域广泛应用。尽管神经表示方法发展迅速,但针对微观场景的专用方法仍较少。现有方法常因失焦和样本畸变导致高频信息丢失,性能受限;且包括RLD、INR和监督U-Net在内的方法普遍存在对初始估计敏感、依赖大量标注数据、计算效率低等问题,严重制约其在复杂生物场景中的实用性。本文提出PNR(Physics-informed Neural Representation),一种用于高分辨率LFM重建的新方法,显著提升性能。该方法采用无监督显式特征表示,相比RLD实现6.1 dB的PSNR提升;引入基于频率的训练损失,更好恢复高频细节,使LPIPS较当前最优方法(DINER)降低超过一半(1.762 vs 3.646)。此外,PNR集成物理引导的畸变校正策略,在优化过程中联合优化泽尼克多项式参数,有效减少畸变引起的信噪损失,提升空间分辨率。这些改进使PNR成为长期高分辨率生物成像的有力解决方案。代码与数据集将公开。

原文摘要 · Abstract (English)

Light field microscopy (LFM) has been widely utilized in various fields for its capability to efficiently capture high-resolution 3D scenes. Despite the rapid advancements in neural representations, there are few methods specifically tailored for microscopic scenes. Existing approaches often do not adequately address issues such as the loss of high-frequency information due to defocus and sample aberration, resulting in suboptimal performance. In addition, existing methods, including RLD, INR, and supervised U-Net, face challenges such as sensitivity to initial estimates, reliance on extensive labeled data, and low computational efficiency, all of which significantly diminish the practicality in complex biological scenarios. This paper introduces PNR (Physics-informed Neural Representation), a method for high-resolution LFM reconstruction that significantly enhances performance. Our method incorporates an unsupervised and explicit feature representation approach, resulting in a 6.1 dB improvement in PSNR than RLD. Additionally, our method employs a frequency-based training loss, enabling better recovery of high-frequency details, which leads to a reduction in LPIPS by at least half compared to SOTA methods (1.762 V.S. 3.646 of DINER). Moreover, PNR integrates a physics-informed aberration correction strategy that optimizes Zernike polynomial parameters during optimization, thereby reducing the information loss caused by aberrations and improving spatial resolution. These advancements make PNR a promising solution for long-term high-resolution biological imaging applications. Our code and dataset will be made publicly available.

显微成像神经表示物理模型图像重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。