提出IC-MoE模型,提升医学图像分割基础模型的高阶特征表达与权重结构稳定性。
Intelligent Communication Mixture-of-Experts Boosted-Medical Image Segmentation Foundation Model
- 构建基础、语义与自适应专家,通过概率投票实现专家选择与融合。
- 在三个公开数据集上超越现有最先进模型,显著提升分割精度。
- 适合需要高精度与强泛化能力的医学图像分割研究者使用。
医学图像分割的基础模型已取得显著性能。自然图像分割基础模型的自适应微调对医学图像分割任务至关重要。然而,现有微调方法存在两大局限:1)高层次特征表征不足;2)微调过程破坏预训练权重的结构完整性。针对上述问题,我们提出一种智能通信混合专家增强型医学图像分割基础模型IC-MoE,包含双重创新:1)构建基础专家、语义专家与自适应专家,并引入像素概率自适应投票策略,通过标签一致性与负载均衡实现专家选择与融合,初步增强了高层次特征表达能力,同时保持预训练权重结构完整性;2)提出语义引导对比学习方法,缓解对比学习中弱监督问题,进一步提升高层次特征表达能力并维持权重结构完整性。在三个公开医学图像分割数据集上的大量实验表明,IC-MoE优于其他最先进模型。结果证明,IC-MoE有效补充了基础医学图像分割模型的高层次特征表达与预训练结构完整性,且在多种医学图像分割场景中展现出优越泛化能力。
原文摘要 · Abstract (English)
Foundation models for medical image segmentation have achieved remarkable performance. Adaptive fine-tuning of natural image segmentation foundation models is crucial for medical image segmentation tasks. However, some limitations exist in existing fine-tuning methods: 1) insufficient representation of high-level features and 2) the fine-tuning process disrupts the structural integrity of pretrained weights. Inspired by these critical problems, we propose an intelligent communication mixture-of-experts boosted-medical image segmentation foundation model, named IC-MoE, with twofold ideas: 1) We construct basic experts, semantic experts, and adaptive experts. Moreover, we implement a pixel probability adaptive voting strategy, which enables expert selection and fusion through label consistency and load balancing. This approach preliminarily enhances the representation capability of high-level features while preserving the structural integrity of pretrained weights. 2) We propose a semantic-guided contrastive learning method to address the issue of weak supervision in contrastive learning. This method further enhances the representation capability of high-level features while preserving the structural integrity of pretrained weights. Extensive experiments across three public medical image segmentation datasets demonstrate that the IC-MoE outperforms other SOTA models. Consequently, the proposed IC-MoE effectively supplements foundational medical image segmentation models with high-level features and pretrained structural integrity. We also validate the superior generalizability of the IC-MoE across diverse medical image segmentation scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。