用自监督学习提升3D显微图像分割的泛化能力
SELMA3D challenge: Self-supervised learning for 3D light-sheet microscopy image segmentation
- 在大规模3D光片显微图像上训练自监督模型
- 模型在跨域数据上分割准确率显著提升
- 适合生物图像分析与医学影像研究者
光片显微技术结合组织透明化,实现了大体积哺乳动物组织的细胞分辨率3D成像。随着深度学习推动大规模数据分析发展,分割作为分析关键步骤,可借助领域专用模型实现专家级性能。然而,现有模型对领域偏移敏感,在训练分布外数据上表现急剧下降。为解决此问题,受自监督学习成功启发,我们在MICCAI 2024组织了SELMA3D挑战赛。该数据集包含35个大型3D图像(每个超过1000³体素)和315个标注小块,覆盖血管样、点状等多样生物结构。五支团队参与全部阶段,结果表明:在大规模数据上进行自监督学习能有效提升分割模型性能与泛化能力。我们将持续支持并扩展SELMA3D,作为首个聚焦3D显微图像分割的自监督学习挑战。
原文摘要 · Abstract (English)
Recent innovations in light sheet microscopy, paired with developments in tissue clearing techniques, enable the 3D imaging of large mammalian tissues with cellular resolution. Combined with the progress in large-scale data analysis, driven by deep learning, these innovations empower researchers to rapidly investigate the morphological and functional properties of diverse biological samples. Segmentation, a crucial preliminary step in the analysis process, can be automated using domain-specific deep learning models with expert-level performance. However, these models exhibit high sensitivity to domain shifts, leading to a significant drop in accuracy when applied to data outside their training distribution. To address this limitation, and inspired by the recent success of self-supervised learning in training generalizable models, we organized the SELMA3D Challenge during the MICCAI 2024 conference. SELMA3D provides a vast collection of light-sheet images from cleared mice and human brains, comprising 35 large 3D images-each with over 1000^3 voxels-and 315 annotated small patches for finetuning, preliminary testing and final testing. The dataset encompasses diverse biological structures, including vessel-like and spot-like structures. Five teams participated in all phases of the challenge, and their proposed methods are reviewed in this paper. Quantitative and qualitative results from most participating teams demonstrate that self-supervised learning on large datasets improves segmentation model performance and generalization. We will continue to support and extend SELMA3D as an inaugural MICCAI challenge focused on self-supervised learning for 3D microscopy image segmentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。