用3D脑影像和注意力机制预测帕金森病分期,准确率超传统方法。
Deep Convolutional Neural Networks on Multiclass Classification of Three-Dimensional Brain Images for Parkinson's Disease Stage Prediction
- 将3D脑影像切片输入2D CNN,结合注意力机制突出关键层。
- 基于ImageNet预训练的2D模型在两个数据集上表现最佳,准确率达87.6%。
- 跨医院数据联合训练提升模型泛化能力,适合医疗影像分析研究者。
帕金森病(PD)是一种中枢神经系统退行性疾病,通常通过单光子发射计算机断层扫描(SPECT)等功能医学成像技术诊断。本研究利用来自两家医院的两组SPECT数据集(分别为n=634和n=202),构建能够准确预测PD分期的多类分类模型。采用完整的三维(3D)脑影像作为输入,测试了多种模型架构。首先,将3D图像视为二维(2D)切片序列,依次输入在ImageNet上预训练的2D卷积神经网络(CNN),并平均输出以得到最终分期预测;同时应用在Kinetics-400上预训练的3D CNN模型。此外,引入注意力机制以捕捉不同切片在预测中的重要性差异。为进一步提升模型性能与鲁棒性,采用权重共享的联合训练(cotraining)策略,同时训练两组数据集。结果表明,在两个数据集上,基于ImageNet预训练的2D模型优于在Kinetics-400上预训练的3D模型,而使用注意力机制的模型则在所有模型中表现最优。当联合训练的数据集足够大时,cotraining技术显著提升了模型性能。
原文摘要 · Abstract (English)
Parkinson's disease (PD), a degenerative disorder of the central nervous system, is commonly diagnosed using functional medical imaging techniques such as single-photon emission computed tomography (SPECT). In this study, we utilized two SPECT data sets (n = 634 and n = 202) from different hospitals to develop a model capable of accurately predicting PD stages, a multiclass classification task. We used the entire three-dimensional (3D) brain images as input and experimented with various model architectures. Initially, we treated the 3D images as sequences of two-dimensional (2D) slices and fed them sequentially into 2D convolutional neural network (CNN) models pretrained on ImageNet, averaging the outputs to obtain the final predicted stage. We also applied 3D CNN models pretrained on Kinetics-400. Additionally, we incorporated an attention mechanism to account for the varying importance of different slices in the prediction process. To further enhance model efficacy and robustness, we simultaneously trained the two data sets using weight sharing, a technique known as cotraining. Our results demonstrated that 2D models pretrained on ImageNet outperformed 3D models pretrained on Kinetics-400, and models utilizing the attention mechanism outperformed both 2D and 3D models. The cotraining technique proved effective in improving model performance when the cotraining data sets were sufficiently large.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。