将脑网络与临床报告对齐,提升阿尔茨海默病早期诊断能力
Bridging Brain Connectomes and Clinical Reports for Early Alzheimer's Disease Diagnosis
- 把脑子网络当作'词',与医生笔记文字对齐
- 在ADNI数据集上达到顶尖预测效果
- 适合关注多模态医学诊断的临床研究者
将脑成像数据与临床报告融合,可充分利用多模态信息实现更高效、及时的临床诊断。尽管该方法在脑疾病研究中备受关注,但核心挑战在于如何有效连接客观影像数据与主观文本报告(如医生笔记)。本文提出一种新框架,在个体和脑网络层面将脑连接组与临床报告映射到共享的跨模态潜在空间,增强表示学习。关键创新在于将脑子网络视为影像数据的'令牌',而非原始图像块,以匹配临床报告中的词元。这使得系统级关联(如神经影像发现与临床观察)的识别更高效,因为脑疾病常表现为网络异常而非孤立区域改变。我们在轻度认知障碍(MCI)数据上应用该方法,结果不仅达到当前最优预测性能,还识别出具有临床意义的连接组-文本配对,为阿尔茨海默病早期机制提供新见解,并支持开发临床可用的多模态生物标志物。
原文摘要 · Abstract (English)
Integrating brain imaging data with clinical reports offers a valuable opportunity to leverage complementary multimodal information for more effective and timely diagnosis in practical clinical settings. This approach has gained significant attention in brain disorder research, yet a key challenge remains: how to effectively link objective imaging data with subjective text-based reports, such as doctors' notes. In this work, we propose a novel framework that aligns brain connectomes with clinical reports in a shared cross-modal latent space at both the subject and connectome levels, thereby enhancing representation learning. The key innovation of our approach is that we treat brain subnetworks as tokens of imaging data, rather than raw image patches, to align with word tokens in clinical reports. This enables a more efficient identification of system-level associations between neuroimaging findings and clinical observations, which is critical since brain disorders often manifest as network-level abnormalities rather than isolated regional alterations. We applied our method to mild cognitive impairment (MCI) using the ADNI dataset. Our approach not only achieves state-of-the-art predictive performance but also identifies clinically meaningful connectome-text pairs, offering new insights into the early mechanisms of Alzheimer's disease and supporting the development of clinically useful multimodal biomarkers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。