用脑影像知识指导语音分析,低成本筛查阿尔茨海默病前期
MINT: Multimodal Imaging-to-Speech Knowledge Transfer for Early Alzheimer's Screening

- 从脑影像提取生物标志物,迁移至语音模型训练中
- 语音识别准确率达AUC 0.720,与纯语音模型相当
- 无需扫描仪即可实现精准筛查,适合大规模应用
阿尔茨海默病是一种进行性神经退行性疾病,轻度认知障碍(MCI)是老化向痴呆过渡的关键阶段。结构磁共振成像(MRI)可提供该阶段的生物标志物,但成本高、设备要求严,难以大规模应用。语音分析作为非侵入性替代方案,现有方法独立于脑影像训练,导致决策边界缺乏生物学依据,对正常人(CN)与轻度认知障碍(MCI)的细微区分能力受限。本文提出MINT(多模态影像到语音的知识迁移)框架,分三阶段将MRI生物标志物结构迁移至语音编码器。基于1,228名受试者的MRI教师模型构建紧凑的影像嵌入空间,用于区分CN与MCI。通过残差投影头结合几何损失,将语音表征对齐至冻结的影像流形,同时保持影像编码器的稳定性。推理时使用未接触过语音的冻结MRI分类器,无需扫描仪。在ADNI-4数据集上,对齐后的语音模型达到AUC 0.720,与纯语音基线(AUC 0.711)相当;多模态融合性能优于单一影像(0.973 vs 0.958)。消融实验表明,丢弃正则化与自监督预训练是关键设计。据我们所知,这是首个实现影像到语音知识迁移的早期阿尔茨海默病筛查工作,建立了无需推理时影像即可实现群体级认知筛检的生物合理路径。
原文摘要 · Abstract (English)
Alzheimer's disease is a progressive neurodegenerative disorder in which mild cognitive impairment (MCI) marks a critical transition between aging and dementia. Neuroimaging modalities, such as structural MRI, provide biomarkers of this transition; however, their high costs and infrastructure needs limit their deployment at a population scale. Speech analysis offers a non-invasive alternative, but speech-only classifiers are developed independently of neuroimaging, leaving decision boundaries biologically ungrounded and limiting reliability on the subtle CN-versus-MCI distinction. We propose MINT (Multimodal Imaging-to-Speech Knowledge Transfer), a three-stage cross-modal framework that transfers biomarker structure from MRI into a speech encoder at training time. An MRI teacher, trained on 1,228 subjects, defines a compact neuroimaging embedding space for CN-versus-MCI classification. A residual projection head aligns speech representations to this frozen imaging manifold via a combined geometric loss, adapting speech to the learned biomarker space while preserving imaging encoder fidelity. The frozen MRI classifier, which is never exposed to speech, is applied to aligned embeddings at inference and requires no scanner. Evaluation on ADNI-4 shows aligned speech achieves performance comparable to speech-only baselines (AUC 0.720 vs 0.711) while requiring no imaging at inference, demonstrating that MRI-derived decision boundaries can ground speech representations. Multimodal fusion improves over MRI alone (0.973 vs 0.958). Ablation studies identify dropout regularization and self-supervised pretraining as critical design decisions. To our knowledge, this is the first demonstration of MRI-to-speech knowledge transfer for early Alzheimer's screening, establishing a biologically grounded pathway for population-level cognitive triage without neuroimaging at inference.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。