arXiv:2505.00592cs.CVcs.LG2025-05被引 3

解决医学图像分级中的数据不平衡问题,提升模型鲁棒性。

Uncertainty-Aware Multi-Expert Knowledge Distillation for Imbalanced Disease Grading

  • 通过不确定性感知的多专家知识蒸馏,动态调整知识迁移权重。
  • 在前列腺组织和眼底图像分级任务中均达到新最好性能。
  • 适合临床部署,尤其适用于数据分布不均的医疗场景。

自动疾病图像分级是人工智能在医疗领域的重要应用,可实现更快更准的患者评估。然而,域偏移问题在数据不平衡时加剧,导致模型引入偏差,影响临床部署。为此,我们提出一种新的不确定性感知多专家知识蒸馏(UMKD)框架,将多个专家模型的知识迁移至单一学生模型。具体地,为提取区分性特征,UMKD 在特征空间中采用浅层紧凑的特征对齐,分离任务无关与任务相关特征;在输出空间,设计不确定性感知的解耦蒸馏(UDD)机制,根据专家模型不确定性动态调整知识转移权重,确保蒸馏过程稳健可靠。此外,UMKD 还解决了以往方法未充分处理的模型架构异质性和源-目标域分布差异问题。在前列腺组织学分级(SICAPv2)和眼底图像分级(APTOS)上的大量实验表明,UMKD 在源不平衡和目标不平衡场景下均取得新最优结果,为真实世界疾病图像分级提供了鲁棒且实用的解决方案。

原文摘要 · Abstract (English)

Automatic disease image grading is a significant application of artificial intelligence for healthcare, enabling faster and more accurate patient assessments. However, domain shifts, which are exacerbated by data imbalance, introduce bias into the model, posing deployment difficulties in clinical applications. To address the problem, we propose a novel \textbf{U}ncertainty-aware \textbf{M}ulti-experts \textbf{K}nowledge \textbf{D}istillation (UMKD) framework to transfer knowledge from multiple expert models to a single student model. Specifically, to extract discriminative features, UMKD decouples task-agnostic and task-specific features with shallow and compact feature alignment in the feature space. At the output space, an uncertainty-aware decoupled distillation (UDD) mechanism dynamically adjusts knowledge transfer weights based on expert model uncertainties, ensuring robust and reliable distillation. Additionally, UMKD also tackles the problems of model architecture heterogeneity and distribution discrepancies between source and target domains, which are inadequately tackled by previous KD approaches. Extensive experiments on histology prostate grading (\textit{SICAPv2}) and fundus image grading (\textit{APTOS}) demonstrate that UMKD achieves a new state-of-the-art in both source-imbalanced and target-imbalanced scenarios, offering a robust and practical solution for real-world disease image grading.

知识蒸馏医学图像不平衡学习不确定性建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。