用3D CNN和跨模态迁移学习提升难诊断癫痫脑病的MRI识别准确率
Focal Cortical Dysplasia Type II Detection Using Cross Modality Transfer Learning and Grad-CAM in 3D-CNNs for MRI Analysis
- 采用跨模态迁移学习,用分割任务预训练权重提升模型性能
- 最高分类准确率达80.3%,热力图评分显著改善定位精度
- 结合Grad-CAM实现可解释性,帮助医生理解AI决策依据
局灶性皮层发育不良II型是药物难治性癫痫的主要病因,常需手术治疗。然而其在MRI上表现细微,诊断困难,易误诊。本研究基于170名受试者(85例患者与85例对照)的T1加权和FLAIR MRI数据,采用3D卷积神经网络(3D-CNNs)进行检测,重点探究跨模态迁移学习与可解释人工智能(XAI)技术(尤其是梯度加权类激活映射,Grad-CAM)的效果。使用ResNet-18、-34和-50架构,通过来自分割任务的预训练权重实施迁移学习。结果表明,迁移学习显著提升分类准确率(最高达80.3%),并引入新型热力评分(Heat-Score)评估模型对临床相关区域的关注程度。热力评分的提升证实了模型在癫痫病灶定位上的能力,使AI预测与临床判断更贴近。研究强调了跨模态迁移学习与XAI在复杂病理医学诊断中的关键作用。
原文摘要 · Abstract (English)
Focal cortical dysplasia (FCD) type II is a major cause of drug-resistant epilepsy, often curable only by surgery. Despite its clinical importance, the diagnosis of FCD is very difficult in MRI because of subtle abnormalities, leading to misdiagnosis. This study investigates the use of 3D convolutional neural networks (3D-CNNs) for FCD detection, using a dataset of 170 subjects (85 FCD patients and 85 controls) composed of T1-weighted and FLAIR MRI scans. In particular, it investigates the benefits obtained from cross-modality transfer learning and explainable artificial intelligence (XAI) techniques, in particular Gradient-weighted Class Activation Mapping (Grad-CAM). ResNet architectures (ResNet-18, -34, and -50) were implemented, employing transfer learning strategies that used pre-trained weights from segmentation tasks. Results indicate that transfer learning significantly enhances classification accuracy (up to 80.3%) and interpretability, as measured by a novel Heat-Score metric, which evaluates the model's focus on clinically relevant regions. Improvements in the Heat-Score metric underscore the model's seizure zone localization capabilities, bringing AI predictions and clinical insights closer together. These results highlight the importance of transfer learning, including cross-modality, and XAI in advancing AI-based medical diagnostics, especially for difficult-to-diagnose pathologies such as FCD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。