用深度生成模型提升荧光显微镜光谱解混,自动去除噪声并处理重叠光谱。
λSplit: Self-Supervised Content-Aware Spectral Unmixing for Fluorescence Microscopy
- 基于变分自编码器构建条件生成模型,学习浓度图的结构先验。
- 在66个挑战性数据集上优于10种基线方法,高噪声与光谱重叠下仍稳健。
- 兼容标准共聚焦显微镜数据,无需硬件改造即可直接使用。
在荧光显微镜中,光谱解混旨在从混合荧光发射的光谱图像中恢复各荧光染料的浓度。传统方法逐像素进行最小二乘拟合,当发射光谱重叠加剧或噪声水平升高时性能下降,表明需采用能学习并利用结构先验的数据驱动方法。现有基于学习的方法或不针对显微镜数据优化,或仅适用于特定场景,难以推广至荧光显微镜。为此,我们提出λSplit,一种物理信息嵌入的深度生成模型,通过分层变分自编码器学习浓度图的条件分布。全可微的光谱混合器确保与成像过程一致,学习到的结构先验实现最先进的解混效果及隐式降噪。我们在3个真实世界数据集上合成生成66个具有挑战性的光谱解混基准,对比了包括经典方法和多种学习型方法在内的10种基线。结果表明,λSplit在高噪声、光谱高度重叠或光谱维度降低条件下均表现优异,达到荧光显微镜光谱解混新基准。重要的是,λSplit兼容标准共聚焦显微镜产生的光谱数据,无需硬件改动即可立即部署。
原文摘要 · Abstract (English)
In fluorescence microscopy, spectral unmixing aims to recover individual fluorophore concentrations from spectral images that capture mixed fluorophore emissions. Since classical methods operate pixel-wise and rely on least-squares fitting, their performance degrades with increasingly overlapping emission spectra and higher levels of noise, suggesting that a data-driven approach that can learn and utilize a structural prior might lead to improved results. Learning-based approaches for spectral imaging do exist, but they are either not optimized for microscopy data or are developed for very specific cases that are not applicable to fluorescence microscopy settings. To address this, we propose λSplit, a physics-informed deep generative model that learns a conditional distribution over concentration maps using a hierarchical Variational Autoencoder. A fully differentiable Spectral Mixer enforces consistency with the image formation process, while the learned structural priors enable state-of-the-art unmixing and implicit noise removal. We demonstrate λSplit on 3 real-world datasets that we synthetically cast into a total of 66 challenging spectral unmixing benchmarks. We compare our results against a total of 10 baseline methods, including classical methods and a range of learning-based methods. Our results consistently show competitive performance and improved robustness in high noise regimes, when spectra overlap considerably, or when the spectral dimensionality is lowered, making λSplit a new state-of-the-art for spectral unmixing of fluorescent microscopy data. Importantly, λSplit is compatible with spectral data produced by standard confocal microscopes, enabling immediate adoption without specialized hardware modifications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。