arXiv:2509.26502eess.IVcs.CV2025-09被引 3

用视觉变压器集成模型提升胃肠道疾病分类准确率,支持可解释诊断。

GastroViT: A Vision Transformer Based Ensemble Learning Approach for Gastrointestinal Disease Classification with Grad CAM & SHAP Visualization

  • 采用MobileViT_XS与MobileViT_V2_200的集成学习方法
  • 23类识别准确率达91.98%,16类时达92.70%
  • 结合Grad-CAM与SHAP提升模型可解释性,适合临床辅助诊断

人类胃肠道可出现多种黏膜异常,从轻微炎症到致命疾病不等。及时识别胃肠道疾病有助于阻止病情进展并改善治疗效果。本文提出一种基于预训练视觉变压器(ViTs)的集成学习模型,用于准确分类胃肠道内镜图像,实现疾病分型。所提模型在公开的HyperKvasir数据集上进行评估,该数据集包含10,662张23种胃肠道疾病的图像。通过集成两个预训练模型MobileViT_XS(准确率90.57%)和MobileViT_V2_200(准确率90.48%),构建的GastroViT模型在23类测试中平均精度、召回率、F1分数和准确率分别为69%、63%、64%和91.98%;在16类测试中分别提升至87%、86%、87%和92.70%。模型仅含2000万参数,未使用数据增强且面对高度不平衡数据仍表现优异。同时引入可解释AI方法如Grad-CAM与SHAP,增强模型透明度,为真实医疗场景下的可靠诊断提供支持。

原文摘要 · Abstract (English)

The gastrointestinal (GI) tract of humans can have a wide variety of aberrant mucosal abnormality findings, ranging from mild irritations to extremely fatal illnesses. Prompt identification of gastrointestinal disorders greatly contributes to arresting the progression of the illness and improving therapeutic outcomes. This paper presents an ensemble of pre-trained vision transformers (ViTs) for accurately classifying endoscopic images of the GI tract to categorize gastrointestinal problems and illnesses. ViTs, attention-based neural networks, have revolutionized image recognition by leveraging the transformative power of the transformer architecture, achieving state-of-the-art (SOTA) performance across various visual tasks. The proposed model was evaluated on the publicly available HyperKvasir dataset with 10,662 images of 23 different GI diseases for the purpose of identifying GI tract diseases. An ensemble method is proposed utilizing the predictions of two pre-trained models, MobileViT_XS and MobileViT_V2_200, which achieved accuracies of 90.57% and 90.48%, respectively. All the individual models are outperformed by the ensemble model, GastroViT, with an average precision, recall, F1 score, and accuracy of 69%, 63%, 64%, and 91.98%, respectively, in the first testing that involves 23 classes. The model comprises only 20 million (M) parameters, even without data augmentation and despite the highly imbalanced dataset. For the second testing with 16 classes, the scores are even higher, with average precision, recall, F1 score, and accuracy of 87%, 86%, 87%, and 92.70%, respectively. Additionally, the incorporation of explainable AI (XAI) methods such as Grad-CAM (Gradient Weighted Class Activation Mapping) and SHAP (Shapley Additive Explanations) enhances model interpretability, providing valuable insights for reliable GI diagnosis in real-world settings.

视觉变换器疾病分类可解释AI内镜图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。