用超网络统一优化医学图像模型结构与初始化,提升精度和收敛速度。
MedNNS: Supernet-based Medical Task-Adaptive Neural Network Search
- 构建医疗图像元空间,联合搜索模型架构与权重初始化
- 相比SOTA提升1.7%平均准确率,收敛更快,模型库扩大51倍
- 适合需要快速适配新医疗任务的研究者和临床部署场景
深度学习在医学影像领域取得显著进展,但模型适配仍面临两大挑战:(1)任务特异性导致的架构选择困难;(2)权重初始化影响收敛速度与最终性能。尽管基于ImageNet的迁移学习广泛应用,但自然图像与医学图像差异大,效果受限。为此,我们提出首个面向医学影像的神经网络搜索框架MedNNS,通过构建融合数据集与模型表现的元空间,联合优化架构选择与权重初始化。采用超网络方法,将模型库规模扩大至前SOTA方法的51倍。引入秩损失与弗雷谢入学距离(FID)损失,以捕捉模型间与数据集间的关联关系,实现更精准的元空间对齐。在多个数据集上的实验表明,MedNNS显著优于ImageNet预训练模型及现有SOTA NAS方法,平均准确率提升1.7%,且收敛速度明显加快。代码与处理后的元空间已公开于https://github.com/BioMedIA-MBZUAI/MedNNS。
原文摘要 · Abstract (English)
Deep learning (DL) has achieved remarkable progress in the field of medical imaging. However, adapting DL models to medical tasks remains a significant challenge, primarily due to two key factors: (1) architecture selection, as different tasks necessitate specialized model designs, and (2) weight initialization, which directly impacts the convergence speed and final performance of the models. Although transfer learning from ImageNet is a widely adopted strategy, its effectiveness is constrained by the substantial differences between natural and medical images. To address these challenges, we introduce Medical Neural Network Search (MedNNS), the first Neural Network Search framework for medical imaging applications. MedNNS jointly optimizes architecture selection and weight initialization by constructing a meta-space that encodes datasets and models based on how well they perform together. We build this space using a Supernetwork-based approach, expanding the model zoo size by 51x times over previous state-of-the-art (SOTA) methods. Moreover, we introduce rank loss and Fréchet Inception Distance (FID) loss into the construction of the space to capture inter-model and inter-dataset relationships, thereby achieving more accurate alignment in the meta-space. Experimental results across multiple datasets demonstrate that MedNNS significantly outperforms both ImageNet pre-trained DL models and SOTA Neural Architecture Search (NAS) methods, achieving an average accuracy improvement of 1.7% across datasets while converging substantially faster. The code and the processed meta-space is available at https://github.com/BioMedIA-MBZUAI/MedNNS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。