用物理模型提升荧光显微镜跨模态超分辨图像质量
Physics-Informed Deep Learning Model for Cross-Modality Super-Resolution in Fluorescence Microscopy
- 将显微镜点扩散函数融入生成对抗网络训练目标
- 在频率域分析中结构保真度显著优于传统方法
- 适合需要高物理可信度的生物成像研究者
跨模态图像转换可从低分辨率图像实现超分辨荧光显微成像,降低光毒性与设备要求。但纯数据驱动模型可能生成视觉上合理却不符合光学成像规律的结果。本文提出一种用于共聚焦到STED图像转换的物理信息生成对抗网络,将显微镜特异的点扩散函数(PSF)信息引入训练目标。使用有限配对的共聚焦-STED数据集(来自人源M2巨噬细胞TOM20标记线粒体,跨不同实验日采集)进行模拟与实测PSF评估。通过参考基与非参考基图像质量指标,结合频率与分布敏感分析,验证性能。无参考指标关注空间频率内容、对比度与信噪比等物理相关特性。基于PSF引导的模型在结构保真度、局部偏差减少及与STED参考图像一致性方面均优于非PSF基线,尤其在频域分析中表现突出。结果表明,光学先验可显著提升生成式显微成像模型的结构保真度与物理合理性。
原文摘要 · Abstract (English)
Cross-modality image translation offers a route to super-resolution fluorescence microscopy from low-resolution images while reducing phototoxicity and instrumentation demands. However, purely data-driven models can produce visually plausible outputs that are inconsistent with optical image formation. Here, we propose a physics-informed generative adversarial network for confocal-to-STED image translation that incorporates microscope-specific point spread function information into the training objective. Simulated and experimentally measured PSFs were evaluated using a limited paired confocal-STED dataset of TOM20-labeled mitochondria in human primary M2 macrophages acquired across different experimental days. Performance was assessed using reference-based and non-reference-based image-quality metrics, together with complementary frequency- and distribution-sensitive analyses. The no-reference metrics probed physics-relevant image properties, including spatial-frequency content, contrast, and signal-to-noise behavior. PSF-guided models improved structural fidelity, reduced local deviations, and achieved closer agreement with STED references than non-PSF baselines, particularly in frequency-domain analyses. These results demonstrate that optical priors can improve the structural fidelity and physical plausibility of generative microscopy models for cross-modality super-resolution imaging.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。