通过门控记忆机制提升病理切片分析的判别力与效率
DeltaMIL: Gated Memory Integration for Efficient and Discriminative Whole Slide Image Analysis
- 引入门控差分规则,动态筛选并整合关键组织区域信息
- 在生存预测和切片分类任务中分别提升3.69%和3.75%准确率
- 适合需要高效处理大规模异质病理切片的研究者使用
全切片图像(WSIs)通常采用多实例学习(MIL)方法分析。然而,WSI的规模与异质性导致信息高度冗余且分散,难以识别和整合判别性特征。现有MIL方法或无法有效剔除无意义线索,或难以聚合多个图像块的相关特征,限制了其在大规模异质WSI上的表现。为此,我们提出DeltaMIL,一种新型MIL框架,能显式选择语义相关区域并整合判别性信息。该方法利用门控差分规则,通过遗忘与记忆机制高效过滤和整合信息。差分机制根据当前图像块的相关性动态更新记忆,移除旧值并插入新值;门控机制则加速无关信号的遗忘。此外,DeltaMIL引入互补局部模式混合机制,保留细微病理局部特征。该设计增强了有意义线索的提取,抑制冗余或噪声信息,提升了模型鲁棒性与判别能力。实验表明,DeltaMIL达到领先性能:在生存预测任务中,使用ResNet-50特征时提升3.69%,使用UNI特征时提升2.36%;在切片级分类任务中,分别提升3.09%和3.75%。结果证明其在多种WSI任务中的强而一致表现。
原文摘要 · Abstract (English)
Whole Slide Images (WSIs) are typically analyzed using multiple instance learning (MIL) methods. However, the scale and heterogeneity of WSIs generate highly redundant and dispersed information, making it difficult to identify and integrate discriminative signals. Existing MIL methods either fail to discard uninformative cues effectively or have limited ability to consolidate relevant features from multiple patches, which restricts their performance on large and heterogeneous WSIs. To address this issue, we propose DeltaMIL, a novel MIL framework that explicitly selects semantically relevant regions and integrates the discriminative information from WSIs. Our method leverages the gated delta rule to efficiently filter and integrate information through a block combining forgetting and memory mechanisms. The delta mechanism dynamically updates the memory by removing old values and inserting new ones according to their correlation with the current patch. The gating mechanism further enables rapid forgetting of irrelevant signals. Additionally, DeltaMIL integrates a complementary local pattern mixing mechanism to retain fine-grained pathological locality. Our design enhances the extraction of meaningful cues and suppresses redundant or noisy information, which improves the model's robustness and discriminative power. Experiments demonstrate that DeltaMIL achieves state-of-the-art performance. Specifically, for survival prediction, DeltaMIL improves performance by 3.69\% using ResNet-50 features and 2.36\% using UNI features. For slide-level classification, it increases accuracy by 3.09\% with ResNet-50 features and 3.75\% with UNI features. These results demonstrate the strong and consistent performance of DeltaMIL across diverse WSI tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。