提出PixelCAM,用像素级分类定位病理图像中的病灶区域。
PixelCAM: Pixel Class Activation Mapping for Histology Image Classification and ROI Localization
- 在共享编码器中同时训练分类与像素级定位任务
- 通过伪标签和部分交叉熵实现精准的前景/背景分割
- 兼容CNN与Transformer,适合医学图像分析场景
弱监督目标定位(WSOL)方法仅需图像级别标签即可训练分类模型并定位感兴趣区域(ROI)。标准方法依赖类激活映射(CAM),采用单步或两步策略。然而,这些方法在病理图像上存在局限:单步法因病灶显著性低、定位线索少,易出现过激活或欠激活;且分类与定位任务收敛不同步。两步法受限于冻结分类器,定位能力受限。此外,对分布外(OOD)数据表现不佳。本文提出PixelCAM,一种多任务学习框架,通过共享图像编码器同步训练分类与像素级定位。在像素特征空间中设计前景/背景分类器,利用预训练WSOL模型生成的像素伪标签,以部分交叉熵进行训练。图像与像素级分类器共同使用梯度下降优化。该方法可无缝集成至CNN与Transformer架构,无需修改。
原文摘要 · Abstract (English)
Weakly supervised object localization (WSOL) methods allow training models to classify images and localize ROIs. WSOL only requires low-cost image-class annotations yet provides a visually interpretable classifier. Standard WSOL methods rely on class activation mapping (CAM) methods to produce spatial localization maps according to a single- or two-step strategy. While both strategies have made significant progress, they still face several limitations with histology images. Single-step methods can easily result in under- or over-activation due to the limited visual ROI saliency in histology images and scarce localization cues. They also face the well-known issue of asynchronous convergence between classification and localization tasks. The two-step approach is sub-optimal because it is constrained to a frozen classifier, limiting the capacity for localization. Moreover, these methods also struggle when applied to out-of-distribution (OOD) datasets. In this paper, a multi-task approach for WSOL is introduced for simultaneous training of both tasks to address the asynchronous convergence problem. In particular, localization is performed in the pixel-feature space of an image encoder that is shared with classification. This allows learning discriminant features and accurate delineation of foreground/background regions to support ROI localization and image classification. We propose PixelCAM, a cost-effective foreground/background pixel-wise classifier in the pixel-feature space that allows for spatial object localization. Using partial-cross entropy, PixelCAM is trained using pixel pseudo-labels collected from a pretrained WSOL model. Both image and pixel-wise classifiers are trained simultaneously using standard gradient descent. In addition, our pixel classifier can easily be integrated into CNN- and transformer-based architectures without any modifications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。