arXiv:2409.20013cs.CVcs.LG2024-09被引 25

用物理驱动神经网络,单张全息图即可重建细胞三维形态与折射率分布。

Single-shot reconstruction of three-dimensional morphology of biological cells in digital holographic microscopy using a physics-driven neural network

  • 融合物理模型与坐标神经网络,从单张全息图直接重建3D光场。
  • 在椭球体和生物细胞的合成与实验数据上实现高精度3D形态重建。
  • 适用于实时动态分析细胞形变与运动,适合生物医学成像研究。

基于深度学习的图像重建技术在数字离轴全息显微镜(DIHM)相位恢复中取得显著进展。然而,现有方法在泛化性能及单张全息图下生物细胞三维(3D)形态重建方面仍存在局限。本文提出一种新型深度学习模型MorpHoloNet,结合物理驱动与坐标基神经网络,实现单张全息图下的3D形态重建。通过模拟相干光穿过3D相位分布的衍射过程,优化模型使模拟全息图与输入全息图在传感器平面上的损失最小化。相比传统需多角度或多次相位移的DIHM方法,MorpHoloNet无需角扫描或多个相位移全息图,可直接从单张全息图重建3D复振幅场与3D形态。在椭球体的合成全息图及生物细胞的实验全息图上验证了其性能。进一步利用连续单张全息图,实现了对细胞3D平动、转动行为及形变的时空动态重建。该模型为生物医学与工程领域中无标记、实时3D成像与动态分析提供了新路径。

原文摘要 · Abstract (English)

Recent advances in deep learning-based image reconstruction techniques have led to significant progress in phase retrieval using digital in-line holographic microscopy (DIHM). However, existing deep learning-based phase retrieval methods have technical limitations in generalization performance and three-dimensional (3D) morphology reconstruction from a single-shot hologram of biological cells. In this study, we propose a novel deep learning model, named MorpHoloNet, for single-shot reconstruction of 3D morphology by integrating physics-driven and coordinate-based neural networks. By simulating the optical diffraction of coherent light through a 3D phase shift distribution, the proposed MorpHoloNet is optimized by minimizing the loss between the simulated and input holograms on the sensor plane. Compared to existing DIHM methods that face challenges with twin image and phase retrieval problems, MorpHoloNet enables direct reconstruction of 3D complex light field and 3D morphology of a test sample from its single-shot hologram without requiring multiple phase-shifted holograms or angle scanning. The performance of the proposed MorpHoloNet is validated by reconstructing 3D morphologies and refractive index distributions from synthetic holograms of ellipsoids and experimental holograms of biological cells. The proposed deep learning model is utilized to reconstruct spatiotemporal variations in 3D translational and rotational behaviors and morphological deformations of biological cells from consecutive single-shot holograms captured using DIHM. MorpHoloNet would pave the way for advancing label-free, real-time 3D imaging and dynamic analysis of biological cells under various cellular microenvironments in biomedical and engineering fields.

全息显微3D重建深度学习生物成像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。