提出一种医学图像特征提取新方法,提升小样本下的分类准确率。
MIAFEx: An Attention-based Feature Extraction Method for Medical Image Classification
- 基于Transformer的可学习优化机制,动态增强分类特征
- 在多个数据集上优于传统模型和现代CNN/ViT,尤其小样本下优势明显
- 适合医疗影像领域数据少、类别差异大的场景
特征提取在医学图像分类中至关重要。传统特征提取器与机器学习分类器常因缺乏足够的判别信息而表现受限。尽管卷积神经网络(CNN)和视觉变换器(ViT)展现出潜力,但受限于医学影像数据的特性——如样本量小或类内方差高,仍易过拟合。本文提出一种新型医学图像注意力特征提取方法(MIAFEx),在Transformer编码器架构中引入可学习的精炼机制,根据学习权重调整分类令牌,从而提升显著特征的提取能力,并增强模型对医学影像挑战的适应性。通过与经典特征提取器及传统/混合分类器对比,验证了MIAFEx输出特征在多个复杂医学影像数据集上的优越性。此外,在分类任务中,其性能超越现代CNN与ViT模型,表现出更高的准确率与鲁棒性,尤其在训练数据有限时,显著优于传统与现代模型。源代码见:https://github.com/Oscar-RamosS/Medical-Image-Attention-based-Feature-Extractor-MIAFEx
原文摘要 · Abstract (English)
Feature extraction techniques are crucial in medical image classification; however, classical feature extractors, in addition to traditional machine learning classifiers, often exhibit significant limitations in providing sufficient discriminative information for complex image sets. While Convolutional Neural Networks (CNNs) and Vision Transformer (ViT) have shown promise in feature extraction, they are prone to overfitting due to the inherent characteristics of medical imaging data, including small sample sizes or high intra-class variance. In this work, the Medical Image Attention-based Feature Extractor (MIAFEx) is proposed, a novel method that employs a learnable refinement mechanism to enhance the classification token within the Transformer encoder architecture. This mechanism adjusts the token based on learned weights, improving the extraction of salient features and enhancing the model's adaptability to the challenges presented by medical imaging data. The MIAFEx output feature quality is compared against classical feature extractors using traditional and hybrid classifiers. Also, the performance of these features is compared against modern CNN and ViT models in classification tasks, demonstrating their superiority in accuracy and robustness across multiple complex medical imaging datasets. This advantage is particularly pronounced in scenarios with limited training data, where traditional and modern models often struggle to generalize effectively. The source code of this proposal can be found at https://github.com/Oscar-RamosS/Medical-Image-Attention-based-Feature-Extractor-MIAFEx
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。