优化卷积网络架构,提升乳腺肿块与膝关节韧带损伤分类精度。
Towards Optimal Convolutional Transfer Learning Architectures for Breast Lesion Classification and ACL Tear Detection
- 采用带跳跃连接的一维卷积分类器,部分解冻ResNet50主干网络
- 膝关节韧带损伤检测AUC达0.9969,乳腺结节恶性度判别AUC为0.9641
- 无需依赖RadImageNet预训练,适合医疗影像小样本场景
现代计算机视觉模型在医学影像分类与分割任务中表现优异,但医学影像数据稀缺常限制从头训练模型的效果。迁移学习成为关键解决方案,通过在小样本上微调高性能模型实现有效应用。梅等(2022)发现,在放射科医生标注的大规模图像数据集RadImageNet上预训练的CNN模型,相比ImageNet预训练,在下游任务中表现更优。本文在此基础上开展全面研究,探索乳腺病变恶性程度判别与前交叉韧带(ACL)撕裂检测的最优卷积神经网络架构,并进行统计分析以比较RadImageNet与ImageNet预训练对下游性能的影响。结果表明,采用带跳跃连接的一维卷积分类器、以ResNet50作为预训练主干网络,并部分解冻主干权重,可获得最佳下游医学分类性能。最佳模型在ACL撕裂检测任务中达到0.9969的AUC,乳腺结节恶性度判别任务中达到0.9641的AUC,表现优于以往多数工作,与梅等(2022)结果相当。但未发现支持RadImageNet预训练在上述两类任务中显著优于ImageNet的证据。
原文摘要 · Abstract (English)
Modern computer vision models have proven to be highly useful for medical imaging classification and segmentation tasks, but the scarcity of medical imaging data often limits the efficacy of models trained from scratch. Transfer learning has emerged as a pivotal solution to this, enabling the fine-tuning of high-performance models on small data. Mei et al. (2022) found that pre-training CNNs on a large dataset of radiologist-labeled images (RadImageNet) enhanced model performance on downstream tasks compared to ImageNet pretraining. The present work extends Mei et al. (2022) by conducting a comprehensive investigation to determine optimal CNN architectures for breast lesion malignancy detection and ACL tear detection, as well as performing statistical analysis to compare the effect of RadImageNet and ImageNet pre-training on downstream model performance. Our findings suggest that 1-dimensional convolutional classifiers with skip connections, ResNet50 pre-trained backbones, and partial backbone unfreezing yields optimal downstream medical classification performance. Our best models achieve AUCs of 0.9969 for ACL tear detection and 0.9641 for breast nodule malignancy detection, competitive with the results reported by Mei et al. (2022) and surpassing other previous works. We do not find evidence confirming RadImageNet pre-training to provide superior downstream performance for ACL tear and breast lesion classification tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。