用两阶段对抗网络提升光片显微镜图像融合质量,解决深度成像难题。
3-D Image-to-Image Fusion in Lightsheet Microscopy by Two-Step Adversarial Network: Contribution to the FuseMyCells Challenge

- 先全局下采样再局部高分辨率重建,结合对抗损失增强细节。
- 核与膜的平均SSIM分别达0.85和0.91,显著提升图像质量。
- 适合需高保真3D细胞成像的研究者,尤其关注光毒性控制的实验设计。
光片显微镜是一种强大的三维成像技术,克服了传统光学与共聚焦显微镜的局限,但存在穿透深度低、深层图像质量下降的问题。多视角光片显微镜通过融合多个视角提升三维分辨率,却同时增加复杂度和光子消耗,可能引发光漂白与光毒性。为评估基于深度学习的单视角3D图像融合方法,国际生物医学成像会议(IEEE ISBI 2025)组织了FuseMyCells挑战赛。本文提出一种两步式对抗网络方案:第一阶段处理下采样图像以捕捉全局区域,第二阶段采用基于块的高分辨率推理,并引入对抗损失优化视觉效果。该方法有效应对高分辨率数据、全局上下文需求及高频细节保留等挑战。实验结果表明,该方法在核与膜的平均结构相似性(SSIM)分别超过0.85和0.91,展现出显著的图像融合提升潜力,有助于拓展光片显微镜的应用能力。
原文摘要 · Abstract (English)
Lightsheet microscopy is a powerful 3-D imaging technique that addresses limitations of traditional optical and confocal microscopy but suffers from a low penetration depth and reduced image quality at greater depths. Multiview lightsheet microscopy improves 3-D resolution by combining multiple views but simultaneously increasing the complexity and the photon budget, leading to potential photobleaching and phototoxicity. The FuseMyCells challenge, organized in conjunction with the IEEE ISBI 2025 conference, aims to benchmark deep learning-based solutions for fusing high-quality 3-D volumes from single 3-D views, potentially simplifying procedures and conserving the photon budget. In this work, we propose a contribution to the FuseMyCells challenge based on a two-step procedure. The first step processes a downsampled version of the image to capture the entire region of interest, while the second step uses a patch-based approach for high-resolution inference, incorporating adversarial loss to enhance visual outcomes. This method addresses challenges related to high data resolution, the necessity of global context, and the preservation of high-frequency details. Experimental results demonstrate the effectiveness of our approach, highlighting its potential to improve 3-D image fusion quality and extend the capabilities of lightsheet microscopy. The average SSIM for the nucleus and membranes is greater than 0.85 and 0.91, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。