无需标注数据,用噪声自监督实现光场显微镜3D重建与去噪。
V2V3D: View-to-View Denoised 3D Reconstruction for Light-Field Microscopy
- 基于视图间一致性,设计无监督联合去噪与重建框架。
- 在真实数据集上达到领先性能,计算效率高。
- 适合低信噪比或缺乏标注的生物成像场景。
光场显微镜(LFM)因其能捕捉瞬时、大范围的3D荧光图像而受到广泛关注。然而,现有重建算法对传感器噪声敏感,或需难以获取的真值标注数据进行训练。为此,本文提出V2V3D,一种基于视图到视图的无监督框架,建立了一种统一架构下的图像去噪与3D重建联合优化新范式。我们假设光场图像源自一致的3D信号,各视角噪声独立,从而可应用noise2noise原理实现有效去噪。为增强高频细节恢复,提出一种基于波动光学的特征对齐技术,将波前传播中的点扩散函数转化为专用于特征对齐的卷积核。此外,构建了一个包含光场图像及其对应3D强度体积的LFM数据集。大量实验表明,该方法具有高效计算性能,优于现有最先进方法。这些进展使V2V3D成为复杂条件下3D成像的有力解决方案。
原文摘要 · Abstract (English)
Light field microscopy (LFM) has gained significant attention due to its ability to capture snapshot-based, large-scale 3D fluorescence images. However, existing LFM reconstruction algorithms are highly sensitive to sensor noise or require hard-to-get ground-truth annotated data for training. To address these challenges, this paper introduces V2V3D, an unsupervised view2view-based framework that establishes a new paradigm for joint optimization of image denoising and 3D reconstruction in a unified architecture. We assume that the LF images are derived from a consistent 3D signal, with the noise in each view being independent. This enables V2V3D to incorporate the principle of noise2noise for effective denoising. To enhance the recovery of high-frequency details, we propose a novel wave-optics-based feature alignment technique, which transforms the point spread function, used for forward propagation in wave optics, into convolution kernels specifically designed for feature alignment. Moreover, we introduce an LFM dataset containing LF images and their corresponding 3D intensity volumes. Extensive experiments demonstrate that our approach achieves high computational efficiency and outperforms the other state-of-the-art methods. These advancements position V2V3D as a promising solution for 3D imaging under challenging conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。