arXiv:2508.19574cs.CVcs.AI2025-08被引 2

用图文原型对齐提升病理图像分割的边界精度

Multimodal Prototype Alignment for Semi-supervised Pathology Image Segmentation

  • 通过图像与文本原型引导像素级对比学习
  • 在多个数据集上达到当前最佳分割效果
  • 适合需要精准语义边界的病理分析场景

病理图像分割面临语义边界模糊和像素级标注成本高的挑战。现有基于一致性正则化的半监督方法(如UniMatch)主要依赖图像模态内的扰动一致性,难以捕捉高层语义先验,尤其在结构复杂的病理图像中表现受限。为此,我们提出MPAMatch框架,采用多模态原型引导的像素级对比学习策略。其核心创新在于图像原型与像素标签、文本原型与像素标签之间的双重对比学习,实现结构与语义层面的粗到细监督。该策略不仅增强了未标注样本的判别能力,首次将文本原型监督引入分割任务,显著提升语义边界建模效果。此外,我们用病理预训练基础模型(Uni)替换原TransUNet的ViT骨干网络,更有效提取病理相关特征。在GLAS、EBHI-SEG-GLAND、EBHI-SEG-CANCER和KPI数据集上的实验表明,MPAMatch优于现有先进方法,验证了其在结构与语义建模上的双重优势。

原文摘要 · Abstract (English)

Pathological image segmentation faces numerous challenges, particularly due to ambiguous semantic boundaries and the high cost of pixel-level annotations. Although recent semi-supervised methods based on consistency regularization (e.g., UniMatch) have made notable progress, they mainly rely on perturbation-based consistency within the image modality, making it difficult to capture high-level semantic priors, especially in structurally complex pathology images. To address these limitations, we propose MPAMatch - a novel segmentation framework that performs pixel-level contrastive learning under a multimodal prototype-guided supervision paradigm. The core innovation of MPAMatch lies in the dual contrastive learning scheme between image prototypes and pixel labels, and between text prototypes and pixel labels, providing supervision at both structural and semantic levels. This coarse-to-fine supervisory strategy not only enhances the discriminative capability on unlabeled samples but also introduces the text prototype supervision into segmentation for the first time, significantly improving semantic boundary modeling. In addition, we reconstruct the classic segmentation architecture (TransUNet) by replacing its ViT backbone with a pathology-pretrained foundation model (Uni), enabling more effective extraction of pathology-relevant features. Extensive experiments on GLAS, EBHI-SEG-GLAND, EBHI-SEG-CANCER, and KPI show MPAMatch's superiority over state-of-the-art methods, validating its dual advantages in structural and semantic modeling.

病理分割多模态对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。