arXiv:2409.07584eess.IVcs.AI2024-09被引 2

用双流结构让分割与分类模型互学,提升阿尔茨海默病早期诊断效果

DS-ViT: Dual-Stream Vision Transformer for Cross-Task Distillation in Alzheimer's Early Diagnosis

  • 设计双流嵌入模块,统一分割与分类模型的特征表示
  • 在小数据集上分类准确率显著提升,早诊可提前约6个月
  • 适合做医学图像跨任务学习和早期疾病筛查的研究者

阿尔茨海默病诊断中的分割与分类任务密切相关。在数据稀缺时,共享两任务模型知识可显著提高训练效率。然而,传统知识蒸馏难以弥合分割与分类因任务差异和架构不同带来的鸿沟。为此,我们提出一种双流管道,实现跨任务、跨架构的知识共享。该方法引入双流嵌入模块,统一分割与分类模型的特征表示,通过维度融合引导分类模型。我们在多个3D阿尔茨海默病数据集上验证了该方法,分类性能显著提升,尤其在小样本情况下。此外,我们扩展了管道,加入残差时间注意力机制,利用患者脑组织萎缩前的影像进行早期诊断。该改进使诊断时间提前约6个月,适用于轻度及无症状阶段,为干预争取关键窗口期。

原文摘要 · Abstract (English)

In the field of Alzheimer's disease diagnosis, segmentation and classification tasks are inherently interconnected. Sharing knowledge between models for these tasks can significantly improve training efficiency, particularly when training data is scarce. However, traditional knowledge distillation techniques often struggle to bridge the gap between segmentation and classification due to the distinct nature of tasks and different model architectures. To address this challenge, we propose a dual-stream pipeline that facilitates cross-task and cross-architecture knowledge sharing. Our approach introduces a dual-stream embedding module that unifies feature representations from segmentation and classification models, enabling dimensional integration of these features to guide the classification model. We validated our method on multiple 3D datasets for Alzheimer's disease diagnosis, demonstrating significant improvements in classification performance, especially on small datasets. Furthermore, we extended our pipeline with a residual temporal attention mechanism for early diagnosis, utilizing images taken before the atrophy of patients' brain mass. This advancement shows promise in enabling diagnosis approximately six months earlier in mild and asymptomatic stages, offering critical time for intervention.

阿尔茨海默病双流网络知识蒸馏早期诊断

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。