arXiv:2602.21395cs.CV2026-02中稿 · CVPR被引 4

用动态记忆库提升病理图像的基因组知识迁移效果

Momentum Memory for Knowledge Distillation in Computational Pathology

  • 引入动量更新记忆库,跨批次整合多模态信息
  • 在乳腺癌数据集上准确率提升5.2%,超越现有最佳方法
  • 适合缺乏配对数据的病理诊断模型训练场景

多模态学习融合基因组与组织病理学数据在癌症诊断中展现潜力,但临床应用受限于配对数据稀缺。知识蒸馏(KD)通过将基因组监督信息迁移至病理模型,使仅使用病理图像即可实现精准推理。然而现有方法依赖批次内对齐,因批内对比有限而产生不稳定性,影响性能。为此,我们提出动量记忆知识蒸馏(MoMKD),利用动量更新的记忆库跨批次聚合基因组与病理学信息,显著扩大每个小批量的监督上下文。同时解耦基因组与病理分支的梯度,防止基因组信号主导特征学习,消除推理时模态差异问题。在TCGA-BRCA基准(HER2、PR和ODX分类任务)及独立内部测试数据集上的实验表明,MoMKD持续优于当前最优的MIL与多模态KD基线,在仅病理图像输入下实现更强性能与泛化能力。整体上,MoMKD建立了一种鲁棒且可泛化的计算病理学知识蒸馏范式。

原文摘要 · Abstract (English)

Multimodal learning that integrates genomics and histopathology has shown strong potential in cancer diagnosis, yet its clinical translation is hindered by the limited availability of paired histology-genomics data. Knowledge distillation (KD) offers a practical solution by transferring genomic supervision into histopathology models, enabling accurate inference using histology alone. However, existing KD methods rely on batch-local alignment, which introduces instability due to limited within-batch comparisons and ultimately degrades performance. To address these limitations, we propose Momentum Memory Knowledge Distillation (MoMKD), a cross-modal distillation framework driven by a momentum-updated memory. This memory aggregates genomic and histopathology information across batches, effectively enlarging the supervisory context available to each mini-batch. Furthermore, we decouple the gradients of the genomics and histology branches, preventing genomic signals from dominating histology feature learning during training and eliminating the modality-gap issue at inference time. Extensive experiments on the TCGA-BRCA benchmark (HER2, PR, and ODX classification tasks) and an independent in-house testing dataset demonstrate that MoMKD consistently outperforms state-of-the-art MIL and multimodal KD baselines, delivering strong performance and generalization under histology-only inference. Overall, MoMKD establishes a robust and generalizable knowledge distillation paradigm for computational pathology.

知识蒸馏病理分析多模态学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。