arXiv:2503.21695cs.CVcs.AI2025-03被引 1

让SAM模型学会跨数据集精准分割病理切片中的细胞核

AMA-SAM: Adversarial Multi-Domain Alignment of Segment Anything Model for High-Fidelity Histology Nuclei Segmentation

  • 用条件梯度反转层对齐多源数据特征,保持主数据判别性
  • 设计高分辨率解码器,输出细粒度分割图,捕捉细胞边界
  • 首次将SAM扩展到多域学习,适合医学图像分割研究者

组织病理图像中细胞核的精确分割对生物医学研究和临床应用至关重要。现有方法仅基于单一数据集(主域),忽视利用多元数据源(辅助域)以降低过拟合并提升性能。尽管引入多数据集可缓解过拟合,但常因域偏移导致性能下降。本文提出对抗式多域对齐的分割一切模型(AMA-SAM),通过两项创新克服上述挑战:首先,提出条件梯度反转层(CGRL),一种多域对齐模块,协调不同域特征以促进域不变表示学习,同时保留主数据的关键判别特征;其次,针对SAM固有的低分辨率输出,设计高分辨率解码器(HR-Decoder),直接生成细粒度分割图,以捕捉高分辨率病理图像中复杂的细胞核边界。据我们所知,这是首次将SAM应用于多数据集学习并用于病理细胞核分割。我们在多个公开数据集上验证方法,结果表明其在各项指标上均显著优于当前最优方法。

原文摘要 · Abstract (English)

Accurate segmentation of cell nuclei in histopathology images is essential for numerous biomedical research and clinical applications. However, existing cell nucleus segmentation methods only consider a single dataset (i.e., primary domain), while neglecting to leverage supplementary data from diverse sources (i.e., auxiliary domains) to reduce overfitting and enhance the performance. Although incorporating multiple datasets could alleviate overfitting, it often exacerbates performance drops caused by domain shifts. In this work, we introduce Adversarial Multi-domain Alignment of Segment Anything Model (AMA-SAM) that extends the Segment Anything Model (SAM) to overcome these obstacles through two key innovations. First, we propose a Conditional Gradient Reversal Layer (CGRL), a multi-domain alignment module that harmonizes features from diverse domains to promote domain-invariant representation learning while preserving crucial discriminative features for the primary dataset. Second, we address SAM's inherent low-resolution output by designing a High-Resolution Decoder (HR-Decoder), which directly produces fine-grained segmentation maps in order to capture intricate nuclei boundaries in high-resolution histology images. To the best of our knowledge, this is the first attempt to adapt SAM for multi-dataset learning with application to histology nuclei segmentation. We validate our method on several publicly available datasets, demonstrating consistent and significant improvements over state-of-the-art approaches.

医学图像分割模型多域对齐SAM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。