用自监督学习提取皮肤影像特徵,比用ImageNet预训练更抗过拟合。
Mitigating Overfitting in Medical Imaging: Self-Supervised Pretraining vs. ImageNet Transfer Learning for Dermatological Diagnosis
- 用自编码器在皮肤影像数据上从零训练,学出临床相关的特征空间。
- 自监督模型准确率从45%升至65%,过拟合差距接近零;ImageNet模型过拟合加剧。
- 适合医疗影像领域,尤其当标注数据少、需强泛化能力时使用。
深度学习虽革新了计算机视觉,但高度依赖大规模标注数据和算力。迁移学习(如微调预训练模型)是实用方案,但基于自然图像(如ImageNet)预训练的模型难以捕捉医学影像的领域特异性特征。本研究提出一种无监督学习框架,利用自有皮肤科数据集从零训练变分自编码器(VAE),构建结构化且临床相关的潜在空间。该自监督特征提取器与ImageNet预训练主干在相同分类条件下对比,揭示通用与领域特异性预训练的权衡。结果表明:自监督模型最终验证损失为0.110(下降33.33%),而ImageNet模型停滞于0.100(下降16.67%),显示过拟合。准确率趋势进一步证实:自监督模型从45%提升至65%(+44.44%),过拟合差距近乎为零;而ImageNet模型达87%(+50.00%)后降至75%(+19.05%),过拟合差距扩大至+0.060。这说明尽管ImageNet预训练加速收敛,却放大对非临床相关特征的过拟合。相反,自监督学习实现持续优化、更强泛化性和更高适应性,凸显医疗影像中领域特异性特征提取的重要性。
原文摘要 · Abstract (English)
Deep learning has transformed computer vision but relies heavily on large labeled datasets and computational resources. Transfer learning, particularly fine-tuning pretrained models, offers a practical alternative; however, models pretrained on natural image datasets such as ImageNet may fail to capture domain-specific characteristics in medical imaging. This study introduces an unsupervised learning framework that extracts high-value dermatological features instead of relying solely on ImageNet-based pretraining. We employ a Variational Autoencoder (VAE) trained from scratch on a proprietary dermatological dataset, allowing the model to learn a structured and clinically relevant latent space. This self-supervised feature extractor is then compared to an ImageNet-pretrained backbone under identical classification conditions, highlighting the trade-offs between general-purpose and domain-specific pretraining. Our results reveal distinct learning patterns. The self-supervised model achieves a final validation loss of 0.110 (-33.33%), while the ImageNet-pretrained model stagnates at 0.100 (-16.67%), indicating overfitting. Accuracy trends confirm this: the self-supervised model improves from 45% to 65% (+44.44%) with a near-zero overfitting gap, whereas the ImageNet-pretrained model reaches 87% (+50.00%) but plateaus at 75% (+19.05%), with its overfitting gap increasing to +0.060. These findings suggest that while ImageNet pretraining accelerates convergence, it also amplifies overfitting on non-clinically relevant features. In contrast, self-supervised learning achieves steady improvements, stronger generalization, and superior adaptability, underscoring the importance of domain-specific feature extraction in medical imaging.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。