用低倍率图像实现病理诊断,速度提升10倍以上
Towards Computation- and Communication-efficient Computational Pathology
- 通过自监督对齐低/高倍图像特征,实现高效分析
- 计算时间减少10.7倍,文件传输量降低20倍以上
- 适合手术中快速诊断等时效性强的场景
当前计算病理模型依赖高倍率全切片图像分析,导致诊断效率低下,严重限制其临床应用,尤其在时间敏感或需高效数据传输的场景。为此,我们提出一种新型高效框架MAG-GLTrans,通过低倍率输入实现有效分析,显著降低计算时间、传输需求和存储开销。核心创新在于提出的放大倍率对齐(MAG)机制,采用自监督学习对齐高低倍图像的特征表示,弥合信息差距。在多种基础计算病理任务上,MAG-GLTrans实现领先分类性能,同时达到惊人效率提升:计算时间减少最多10.7倍,文件传输与存储需求降低超过20倍。此外,该框架具备双重扩展性:(1)可作为通用特征提取器提升任意病理模型效率;(2)兼容现有基础模型与组织病理学专用编码器,支持低倍输入且信息损失极小。这些进展使MAG-GLTrans成为手术中冰冻切片诊断等时效性关键场景的理想解决方案。
原文摘要 · Abstract (English)
Despite the impressive performance across a wide range of applications, current computational pathology models face significant diagnostic efficiency challenges due to their reliance on high-magnification whole-slide image analysis. This limitation severely compromises their clinical utility, especially in time-sensitive diagnostic scenarios and situations requiring efficient data transfer. To address these issues, we present a novel computation- and communication-efficient framework called Magnification-Aligned Global-Local Transformer (MAG-GLTrans). Our approach significantly reduces computational time, file transfer requirements, and storage overhead by enabling effective analysis using low-magnification inputs rather than high-magnification ones. The key innovation lies in our proposed magnification alignment (MAG) mechanism, which employs self-supervised learning to bridge the information gap between low and high magnification levels by effectively aligning their feature representations. Through extensive evaluation across various fundamental CPath tasks, MAG-GLTrans demonstrates state-of-the-art classification performance while achieving remarkable efficiency gains: up to 10.7 times reduction in computational time and over 20 times reduction in file transfer and storage requirements. Furthermore, we highlight the versatility of our MAG framework through two significant extensions: (1) its applicability as a feature extractor to enhance the efficiency of any CPath architecture, and (2) its compatibility with existing foundation models and histopathology-specific encoders, enabling them to process low-magnification inputs with minimal information loss. These advancements position MAG-GLTrans as a particularly promising solution for time-sensitive applications, especially in the context of intraoperative frozen section diagnosis where both accuracy and efficiency are paramount.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。