arXiv:2411.07660cs.CV2024-11中稿 · TMI 2025被引 24

提出分层多实例学习框架,提升病理切片细粒度分类精度

HMIL: Hierarchical Multi-Instance Learning for Fine-Grained Whole Slide Image Classification

  • 构建分层标签对齐机制,同时在实例和袋级融合层级关系
  • 在宫颈癌、乳腺癌等3个数据集上达到最优分类准确率
  • 适合需要高精度病理图像分析的研究者与临床医生

全片扫描图像(WSI)的细粒度分类在精准肿瘤学中至关重要,可实现精确癌症诊断与个性化治疗。该任务核心在于区分同一大类下细微的形态差异,而这类图像通常为十亿像素级分辨率,计算挑战巨大。尽管多实例学习(MIL)缓解了计算负担,现有方法常忽略层级标签相关性,将细粒度分类视为扁平的多类分类问题。为此,本文提出新型分层多实例学习(HMIL)框架,通过在实例与袋级别对标签不同层级间的内在关联进行对齐,提供更结构化且信息丰富的学习过程。具体地,HMIL引入类别注意力机制,在实例与袋层级实现层级信息对齐;同时采用监督对比学习增强细粒度判别能力,并设计基于课程学习的动态加权模块,自适应平衡训练中的层级特征。在大规模细胞学宫颈癌(CCC)数据集及两个公开组织学数据集BRACS、PANDA上的大量实验表明,本框架在类别级与整体性能上均达到当前最优。源代码已开源:https://github.com/ChengJin-git/HMIL。

原文摘要 · Abstract (English)

Fine-grained classification of whole slide images (WSIs) is essential in precision oncology, enabling precise cancer diagnosis and personalized treatment strategies. The core of this task involves distinguishing subtle morphological variations within the same broad category of gigapixel-resolution images, which presents a significant challenge. While the multi-instance learning (MIL) paradigm alleviates the computational burden of WSIs, existing MIL methods often overlook hierarchical label correlations, treating fine-grained classification as a flat multi-class classification task. To overcome these limitations, we introduce a novel hierarchical multi-instance learning (HMIL) framework. By facilitating on the hierarchical alignment of inherent relationships between different hierarchy of labels at instance and bag level, our approach provides a more structured and informative learning process. Specifically, HMIL incorporates a class-wise attention mechanism that aligns hierarchical information at both the instance and bag levels. Furthermore, we introduce supervised contrastive learning to enhance the discriminative capability for fine-grained classification and a curriculum-based dynamic weighting module to adaptively balance the hierarchical feature during training. Extensive experiments on our large-scale cytology cervical cancer (CCC) dataset and two public histology datasets, BRACS and PANDA, demonstrate the state-of-the-art class-wise and overall performance of our HMIL framework. Our source code is available at https://github.com/ChengJin-git/HMIL.

病理图像细粒度分类多实例学习分层建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。