用多数据集知识蒸馏统一提升医学图像分割、分类与检测性能
Multi-Dataset Cross-Domain Knowledge Distillation for Unified Medical Image Segmentation, Classification, and Detection

- 联合教师模型融合多源医学影像的通用特征,学生模型分任务蒸馏学习
- 在6个分割、多个分类与检测数据集上均超越单任务与多头基线
- 适合跨模态、跨领域医学图像分析,尤其关注泛化能力的研究者
我们提出一种统一的跨域迁移学习框架,利用多个异构医学影像数据集的知识,提升分割、分类和目标检测任务的性能。该方法采用教师-学生范式:联合教师模型从多样源数据中学习域不变表征,任务特定的学生模型通过多层次知识蒸馏训练。最初为医学图像分割设计,现扩展至图像级分类与对象级检测,实现医学图像分析的通用多任务建模。我们在广泛的数据集上评估,包括六个分割基准(BrainMetShare、ISLES、BraTS(MRI)、Lung MSD、LiTS、KiTS(CT)),以及多个肺病与痴呆分类数据集,还有带真实边界框标注的检测数据集。在所有任务与模态中,该方法均持续优于强基线,展现出对分布偏移更强的鲁棒性与更优的泛化能力。结果表明,多数据集知识蒸馏是一种可扩展、任务无关的方法,能有效提升异构医学影像领域的分割、分类与检测表现。
原文摘要 · Abstract (English)
We propose a unified cross-domain transfer learning framework that leverages knowledge from multiple heterogeneous medical imaging datasets to improve performance across segmentation, classification, and object detection tasks. Our approach employs a teacher-student paradigm in which a joint teacher model aggregates domain-invariant representations learned from diverse source datasets, while a task-specific student model is trained via multi-level knowledge distillation. Originally developed for medical image segmentation, the framework is extended to support image-level classification and object-level detection, enabling a general multi-task formulation for medical image analysis. We evaluate our method on a broad suite of datasets, including six segmentation benchmarks, BrainMetShare, ISLES, BraTS (MRI) and Lung MSD, LiTS, KiTS (CT), as well as multiple classification datasets for pulmonary disease and dementia, and detection datasets with native bounding-box annotations. Across all tasks and modalities, the proposed approach yields consistent improvements over strong dataset-specific and multi-head baselines, demonstrating enhanced robustness to distributional shifts and superior generalization. These findings highlight the potential of multi-dataset knowledge distillation as a scalable and task-agnostic approach for enhancing segmentation, classification, and object detection performance across heterogeneous medical imaging domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。