用自监督学习预训练胶囊网络,提升小样本肠镜息肉识别准确率。
Self-Supervised Learning for Pre-training Capsule Networks: Overcoming Medical Imaging Dataset Challenges
- 设计色彩化与对比学习两种自监督任务,为胶囊网络预训练
- 在PICCOLO数据集上使分类准确率提升5.26%
- 适合小样本、不平衡的医学图像分析场景
深度学习在诊断性医学影像中应用日益广泛,但高质量、大规模医疗数据集稀缺,常需依赖迁移学习。本研究探索自监督学习在结直肠癌息肉诊断中胶囊网络的预训练方法。基于包含3,433个样本的PICCOLO数据集——典型医学数据集存在样本量小、类别不平衡及数据划分分布偏移等问题,胶囊网络因其架构与层间信息路由机制具备内在可解释性,但主流框架中缺乏原生支持与预训练版本,尤其在小样本数据上训练时,初始权重的利用尤为重要。本文尝试了色彩化与对比学习两种辅助自监督任务进行预训练,并与其它初始化策略对比。结果表明,对比学习和图像修复技术适合作为医学领域自监督学习的辅助任务,有效引导模型捕捉对下游息肉分类有益的关键视觉特征,相比其他初始化方法,准确率提升5.26%。
原文摘要 · Abstract (English)
Deep learning techniques are increasingly being adopted in diagnostic medical imaging. However, the limited availability of high-quality, large-scale medical datasets presents a significant challenge, often necessitating the use of transfer learning approaches. This study investigates self-supervised learning methods for pre-training capsule networks in polyp diagnostics for colon cancer. We used the PICCOLO dataset, comprising 3,433 samples, which exemplifies typical challenges in medical datasets: small size, class imbalance, and distribution shifts between data splits. Capsule networks offer inherent interpretability due to their architecture and inter-layer information routing mechanism. However, their limited native implementation in mainstream deep learning frameworks and the lack of pre-trained versions pose a significant challenge. This is particularly true if aiming to train them on small medical datasets, where leveraging pre-trained weights as initial parameters would be beneficial. We explored two auxiliary self-supervised learning tasks, colourisation and contrastive learning, for capsule network pre-training. We compared self-supervised pre-trained models against alternative initialisation strategies. Our findings suggest that contrastive learning and in-painting techniques are suitable auxiliary tasks for self-supervised learning in the medical domain. These techniques helped guide the model to capture important visual features that are beneficial for the downstream task of polyp classification, increasing its accuracy by 5.26% compared to other weight initialisation methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。