arXiv:2509.23097cs.CV2025-09被引 6

用跨倍率蒸馏压缩病理大模型,速度提升30倍且精度损失小于1%。

Streamline pathology foundation model by cross-magnification distillation

  • 通过20倍到5倍倍率的知识蒸馏,将大模型知识迁移到轻量小模型。
  • 处理速度达8.8张/分钟,比现有方法快30倍,精度仅低1%以内。
  • 适合资源受限的临床环境,支持实时病理AI应用。

基础模型(FM)已改变计算病理学,但因参数量大、需高倍率处理而难以临床部署。本文提出XMAG,一种通过跨倍率蒸馏训练的轻量级基础模型,将20倍倍率教师模型的知识迁移至5倍倍率学生架构。XMAG采用紧凑骨干网络,全程运行于5倍倍率,每张全切片图像(WSI)所需补丁数减少11.3倍。新颖的蒸馏框架实现全局图像表征与局部空间标记映射的双层级知识对齐。在包含349万张图像的公开数据集上训练,并在六项涉及多种癌症类型的临床相关病理分析任务中评估。XMAG诊断准确率仅比更大模型低1%,同时实现30倍加速,处理速度达8.8 WSI/分钟。跨机构验证显示其强泛化能力。进一步采用端到端训练策略,使性能逼近大型基础模型。结果表明,跨倍率蒸馏是资源受限临床环境中部署基础模型能力的可行路径,有望实现病理AI的实时集成。

原文摘要 · Abstract (English)

Foundation models (FM) have transformed computational pathology but remain computationally prohibitive for clinical deployment due to their massive parameter counts and high-magnification processing requirements. Here, we introduce XMAG, a lightweight FM developed through corss-magnification distillation that transfers knowledge from state-of-the-art 20x magnification teacher to an efficient 5x magnification student architecture. XMAG employs a compact backbone and operates entirely at 5x, requiring 11.3 times fewer patches per whole slide image (WSI) compared to existing approaches. Our Novel distillation framework incorporates dual-level knowledge transfer, aligning both global image representations and local spatial token mapping. We trained XMAG on 3.49 million images curated from publicly available datasets and evaluated performance across six clinically relevant histopathology analysis tasks spanning multiple cancer types. XMAG achieved diagnostic accuracy within 1% of substantially larger foundation models while delivering 30-fold processing acceleration, reaching 8.8 WSIs per minute processing speed. Our cross-institutional validation confirmed robust generalization. Further, we developed an end-to-end training strategy to further boost our model's performance to approach the larger FMs' performance. These results establish cross-magnification distillation as a viable approach for deploying FM capabilities in resource-constrained clinical environments, potentially enabling real-time pathology AI integration.

病理分析知识蒸馏轻量化模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。