arXiv:2507.17149cs.CVcs.AI2025-07中稿 · 28th European Conf…

解决细胞结构分割中的形态与分布偏差问题,提升模型泛化能力。

ScSAM: Debiasing Morphology and Distributional Variability in Subcellular Semantic Segmentation

  • 融合SAM与MAE先验知识,对齐特征空间并融合多源表示。
  • 在多个数据集上达到新最佳性能,尤其在小样本类别上提升显著。
  • 适合需要高精度细胞结构分割的研究者,如生物医学图像分析。

亚细胞组分在形态和分布上的显著差异给基于学习的细胞器分割模型带来长期挑战,极大增加了特征学习偏倚的风险。现有方法通常依赖单一映射关系,忽略特征多样性,从而引发训练偏差。尽管分割一切模型(SAM)提供丰富特征表示,但其在亚细胞场景中的应用受限于两大关键问题:(1) 亚细胞形态与分布的变异性导致标签空间存在缺口,使模型学习到虚假或偏差特征;(2) SAM侧重全局上下文理解,常忽略细粒度空间细节,难以捕捉细微结构变化及应对数据分布偏斜。为此,我们提出ScSAM,通过融合预训练SAM与掩码自编码器(MAE)引导的细胞先验知识,缓解数据不平衡带来的训练偏差。具体地,设计特征对齐与融合模块,将预训练嵌入映射至同一特征空间,并高效整合不同表示。此外,提出基于余弦相似度矩阵的类别提示编码器,激活特定类别特征以识别亚细胞类型。在多种亚细胞图像数据集上的大量实验表明,ScSAM优于现有最先进方法。

原文摘要 · Abstract (English)

The significant morphological and distributional variability among subcellular components poses a long-standing challenge for learning-based organelle segmentation models, significantly increasing the risk of biased feature learning. Existing methods often rely on single mapping relationships, overlooking feature diversity and thereby inducing biased training. Although the Segment Anything Model (SAM) provides rich feature representations, its application to subcellular scenarios is hindered by two key challenges: (1) The variability in subcellular morphology and distribution creates gaps in the label space, leading the model to learn spurious or biased features. (2) SAM focuses on global contextual understanding and often ignores fine-grained spatial details, making it challenging to capture subtle structural alterations and cope with skewed data distributions. To address these challenges, we introduce ScSAM, a method that enhances feature robustness by fusing pre-trained SAM with Masked Autoencoder (MAE)-guided cellular prior knowledge to alleviate training bias from data imbalance. Specifically, we design a feature alignment and fusion module to align pre-trained embeddings to the same feature space and efficiently combine different representations. Moreover, we present a cosine similarity matrix-based class prompt encoder to activate class-specific features to recognize subcellular categories. Extensive experiments on diverse subcellular image datasets demonstrate that ScSAM outperforms state-of-the-art methods.

细胞分割特征对齐去偏MAE

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。