arXiv:2606.15611cs.CVcs.AI2026-06

用双模型互蒸馏,5个标注病例就实现精准肿瘤分割

Mutual Distillation of Dual-Foundation Models for Semi-Supervised PET/CT Segmentation

论文配图:Mutual Distillation of Dual-Foundation Models for Semi-Supervised PET/CT Segmentation
图 1 · 摘自论文原文
  • 用CT和PET专用基础模型互相蒸馏知识
  • 仅用5个标注样本在AutoPET上达最优性能
  • 无需人工提示,适合标注稀缺的医学图像分割

PET/CT中的器官分割对肿瘤定量分析和放疗规划至关重要。为降低标注成本,半监督学习(SSL)为在有限标注数据下训练深度模型提供了有效方案。近期视觉基础模型展现出出色的适应性与效率。本文提出一种互蒸馏框架,无缝融合结构化与功能性基础模型,分别作为CT和PET影像的模态特异性通用模型,从结构化CT与代谢型PET中提炼知识。通过弥合学生模型的任务特定精度与通用基础模型的分割先验之间的差距,我们提出MuDuo框架,协同利用SAM-Med3D(用于CT)和SegAnyPET(用于PET),将知识蒸馏至轻量级学生网络。该方法无需人工提示,充分挖掘未标注数据潜力,实现自动分割,在仅含5个标注病例的AutoPET数据集上达到当前最优表现。代码已开源:https://github.com/Wu-beining/MuDuo。

原文摘要 · Abstract (English)

Organ segmentation from PET/CT is critical for quantitative analysis and radiotherapy planning in oncology. To ease the high annotation cost of PET/CT segmentation, semi-supervised learning (SSL) provides a practical and effective solution for developing deep models with limited labeled data. Recent developments in visual foundation models have demonstrated remarkable adaptability with improved efficiency. In this work, we propose a mutual distillation framework that seamlessly exploits both structural and functional foundation models, which act as modality-specific generalists for distilling knowledge from structural CT and metabolic PET imaging. By bridging the gap between the task-specific precision of student models and the segmentation priors of generalist foundation models, we propose \textbf{MuDuo}, a mutual distillation framework that synergistically leverages SAM-Med3D for CT and SegAnyPET for PET to distill their knowledge into a lightweight student network. Our approach eliminates the need for manual prompts while maximizing the utility of unlabeled data for automatic segmentation, achieving state-of-the-art performance on the AutoPET dataset with only 5 labeled cases. Our source code is available at https://github.com/Wu-beining/MuDuo.

医学图像分割半监督学习知识蒸馏PET/CT

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。