用提示增强提升弱监督病理图像分割效果,仅需少量标注数据
EP-SAM: Weakly Supervised Histopathology Segmentation via Enhanced Prompt with Segment Anything

- 结合类激活图与SAM生成伪标签,实现弱监督分割
- 在三个乳腺癌数据集上超越现有方法,训练仅需12GB显存
- 适合缺乏大量标注的医学图像分析场景
本文提出一种超越监督学习的新方法,用于高效病理图像分析,解决高质量标注数据稀缺的问题。传统病理诊断依赖医生对形态特征的评估,而近年来计算机辅助诊断(CAD)系统日益受到关注。尽管深度学习显著提升了CAD性能,但分割模型通常需要大规模像素级标注数据,且标注成本高昂。现有非监督方法仍存在泛化能力不足的问题,尚未出现实用方案。为此,我们提出一种弱监督语义分割(WSSS)模型,结合类激活图与基于Segment Anything Model(SAM)的伪标签生成。为实现有效预训练,采用SAM这一在大规模数据上预训练、仅需粗略提示即可零样本运行的基础模型。通过将增强注意力丢弃层的知识迁移至SAM,生成更准确的伪标签。在多个乳腺癌病理数据集上的实验表明,该方法优于其他WSSS方法,在三组数据上均取得领先结果,且训练仅消耗12GB GPU显存。代码已公开于https://github.com/QI-NemoSong/EP-SAM。
原文摘要 · Abstract (English)
This work proposes a novel approach beyond supervised learning for effective pathological image analysis, addressing the challenge of limited robust labeled data. Pathological diagnosis of diseases like cancer has conventionally relied on the evaluation of morphological features by physicians and pathologists. However, recent advancements in compute-aided diagnosis (CAD) systems are gaining significant attention as diagnostic support tools. Although the advancement of deep learning has improved CAD significantly, segmentation models typically require large pixel-level annotated dataset, and such labeling is expensive. Existing studies not based on supervised approaches still struggle with limited generalization, and no practical approach has emerged yet. To address this issue, we present a weakly supervised semantic segmentation (WSSS) model by combining class activation map and Segment Anything Model (SAM)-based pseudo-labeling. For effective pretraining, we adopt the SAM-a foundation model that is pretrained on large datasets and operates in zero-shot configurations using only coarse prompts. The proposed approach transfer enhanced Attention Dropout Layer's knowledge to SAM, thereby generating pseudo-labels. To demonstrate the superiority of the proposed method, experimental studies are conducted on histopathological breast cancer datasets. The proposed method outperformed other WSSS methods across three datasets, demonstrating its efficiency by achieving this with only 12GB of GPU memory during training. Our code is available at : https://github.com/QI-NemoSong/EP-SAM
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。