arXiv:2512.03577cs.CV2025-12中稿 · IEEE BIBM 2025

通过多染色图像对比学习,提升病理切片的通用表示能力

Cross-Stain Contrastive Learning for Paired Immunohistochemistry and Histopathology Slide Representation Learning

  • 设计跨染色对比学习框架,对齐不同染色切片的局部特征
  • 在五种染色数据上实现癌症分型等任务的性能提升
  • 适合需要多模态病理图像分析的研究者使用

通用、可迁移的全切片图像(WSI)表征是计算病理学的核心。将免疫组化(IHC)等多标记与H&E结合,可丰富基于H&E的特征并引入生物意义信息。然而,由于高质量配准的多染色数据稀缺,进展受限。染色间错位导致组织对应关系偏移,影响局部特征一致性,降低整体切片嵌入质量。为此,我们构建了一个五染色(H&E、HER2、KI67、ER、PGR)级对齐数据集,支持成对的H&E-IHC学习与稳健的跨染色表征。基于该数据集,提出跨染色对比学习(CSCL)框架:第一阶段采用轻量适配器进行逐块对比对齐,增强H&E特征与对应IHC上下文的一致性;第二阶段利用多实例学习(MIL)进行切片级表征学习,结合染色特异性特征融合模块与跨染色全局对齐模块,确保不同染色下的切片嵌入一致性。在癌症亚型分类、IHC标志物状态分类和生存预测任务中均取得稳定提升,生成高质量、可迁移的H&E切片级表征。代码与数据见https://github.com/lily-zyz/CSCL。

原文摘要 · Abstract (English)

Universal, transferable whole-slide image (WSI) representations are central to computational pathology. Incorporating multiple markers (e.g., immunohistochemistry, IHC) alongside H&E enriches H&E-based features with diverse, biologically meaningful information. However, progress is limited by the scarcity of well-aligned multi-stain datasets. Inter-stain misalignment shifts corresponding tissue across slides, hindering consistent patch-level features and degrading slide-level embeddings. To address this, we curated a slide-level aligned, five-stain dataset (H&E, HER2, KI67, ER, PGR) to enable paired H&E-IHC learning and robust cross-stain representation. Leveraging this dataset, we propose Cross-Stain Contrastive Learning (CSCL), a two-stage pretraining framework with a lightweight adapter trained using patch-wise contrastive alignment to improve the compatibility of H&E features with corresponding IHC-derived contextual cues, and slide-level representation learning with Multiple Instance Learning (MIL), which uses a cross-stain attention fusion module to integrate stain-specific patch features and a cross-stain global alignment module to enforce consistency among slide-level embeddings across different stains. Experiments on cancer subtype classification, IHC biomarker status classification, and survival prediction show consistent gains, yielding high-quality, transferable H&E slide-level representations. The code and data are available at https://github.com/lily-zyz/CSCL.

病理图像多模态学习对比学习医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。