融合Transformer与U-Net,提升医学图像分割精度与可解释性。
MAPUNetR: A Hybrid Vision Transformer and U-Net Architecture for Efficient and Interpretable Medical Image Segmentation
- 结合视觉Transformer与U-Net结构,兼顾全局感知与局部细节
- BraTS 2020上Dice达0.88,ISIC 2018上达0.92
- 生成注意力图,增强模型决策可解释性,适合临床应用
医学图像分割在医疗中至关重要,有助于提高诊断准确性、制定治疗方案并监测疾病进展。该任务使临床医生能够从视觉数据中提取关键信息,实现个性化患者护理。然而,开发用于分割的神经网络仍具挑战性,尤其是在保持图像分辨率方面,这在检测影响诊断的细微差异时尤为关键。此外,深度学习模型缺乏透明性,阻碍了其在临床实践中的应用。提升模型可解释性的努力日益集中在使模型决策过程更透明。本文提出MAPUNetR,一种将Transformer模型优势与经典U-Net框架相结合的新架构,用于医学图像分割。该模型解决了分辨率保持难题,并引入突出分割区域的注意力图,提升了准确率与可解释性。在BraTS 2020数据集上,其Dice分数达到0.88;在ISIC 2018数据集上,Dice系数为0.92。实验表明,该模型性能稳定,具备成为临床实践中强大分割工具的潜力。
原文摘要 · Abstract (English)
Medical image segmentation is pivotal in healthcare, enhancing diagnostic accuracy, informing treatment strategies, and tracking disease progression. This process allows clinicians to extract critical information from visual data, enabling personalized patient care. However, developing neural networks for segmentation remains challenging, especially when preserving image resolution, which is essential in detecting subtle details that influence diagnoses. Moreover, the lack of transparency in these deep learning models has slowed their adoption in clinical practice. Efforts in model interpretability are increasingly focused on making these models' decision-making processes more transparent. In this paper, we introduce MAPUNetR, a novel architecture that synergizes the strengths of transformer models with the proven U-Net framework for medical image segmentation. Our model addresses the resolution preservation challenge and incorporates attention maps highlighting segmented regions, increasing accuracy and interpretability. Evaluated on the BraTS 2020 dataset, MAPUNetR achieved a dice score of 0.88 and a dice coefficient of 0.92 on the ISIC 2018 dataset. Our experiments show that the model maintains stable performance and potential as a powerful tool for medical image segmentation in clinical practice.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。