提出端到端多尺度病理图像分类模型,提升准确率并减少计算浪费。
MsaMIL-Net: An End-to-End Multi-Scale Aware Multiple Instance Learning Network for Efficient Whole Slide Image Classification
- 设计多尺度特征提取与融合机制,捕捉不同层级病理信息。
- 在三个跨中心数据集上达到更高准确率与AUC值,优于现有方法。
- 适合需要高效精准病理图像分析的研究者与临床辅助诊断系统。
基于包的多实例学习(MIL)已成为全切片图像(WSI)分类的主流方法。然而,现有方法通常采用分段训练策略:先用预训练特征提取器提取特征,再通过MIL聚合。这种策略导致特征提取网络与MIL网络间协同优化不足,难以实现端到端联合优化,限制了模型整体性能。此外,传统方法对所有固定尺寸切片统一提取特征,忽视病理科医生多尺度观察特点,当肿瘤区域占比极低时(如Camelyon16数据集),造成大量计算资源浪费,且可能使模型陷入次优解。为此,本文提出一种端到端多尺度WSI分类框架,融合多尺度特征提取与多实例学习。具体包括:(1) 语义特征过滤模块,降低非病变区域干扰;(2) 多尺度特征提取模块,捕获不同层次病理信息;(3) 多尺度融合MIL模块,实现全局建模与特征整合。通过端到端训练,同步优化特征提取器与MIL网络,确保二者最大兼容性。在三个跨中心数据集(DigestPath2019、BCNB、UBC-OCEAN)上的实验表明,所提方法在准确率(ACC)和AUC指标上均优于当前最优方法。
原文摘要 · Abstract (English)
Bag-based Multiple Instance Learning (MIL) approaches have emerged as the mainstream methodology for Whole Slide Image (WSI) classification. However, most existing methods adopt a segmented training strategy, which first extracts features using a pre-trained feature extractor and then aggregates these features through MIL. This segmented training approach leads to insufficient collaborative optimization between the feature extraction network and the MIL network, preventing end-to-end joint optimization and thereby limiting the overall performance of the model. Additionally, conventional methods typically extract features from all patches of fixed size, ignoring the multi-scale observation characteristics of pathologists. This not only results in significant computational resource waste when tumor regions represent a minimal proportion (as in the Camelyon16 dataset) but may also lead the model to suboptimal solutions. To address these limitations, this paper proposes an end-to-end multi-scale WSI classification framework that integrates multi-scale feature extraction with multiple instance learning. Specifically, our approach includes: (1) a semantic feature filtering module to reduce interference from non-lesion areas; (2) a multi-scale feature extraction module to capture pathological information at different levels; and (3) a multi-scale fusion MIL module for global modeling and feature integration. Through an end-to-end training strategy, we simultaneously optimize both the feature extractor and MIL network, ensuring maximum compatibility between them. Experiments were conducted on three cross-center datasets (DigestPath2019, BCNB, and UBC-OCEAN). Results demonstrate that our proposed method outperforms existing state-of-the-art approaches in terms of both accuracy (ACC) and AUC metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。