用双向注意力融合脑结构与功能影像,提升抑郁症检测准确率
A Dual Cross-Attention Graph Learning Framework For Multimodal MRI-Based Major Depressive Disorder Detection
- 设计双通道交叉注意力机制,显式建模结构与功能影像的双向交互
- 在多尺度脑图谱上实现84.71%准确率,显著优于传统拼接方法
- 适合从事多模态神经影像分析与精神疾病智能诊断的研究者
重度抑郁症(MDD)是一种常见精神障碍,其神经生物学变化复杂,单一成像模态难以全面捕捉。多模态磁共振成像(MRI)通过结合结构磁共振(sMRI)与静息态功能磁共振(rs-fMRI)数据,可更全面揭示脑部变化。然而,多模态有效融合仍具挑战。本文提出一种基于双交叉注意力的多模态融合框架,显式建模sMRI与rs-fMRI表征间的双向交互。该方法在大规模REST-meta-MDD数据集上,采用多种脑图谱配置进行测试。10折分层交叉验证结果表明,所提算法在所有图谱类型下均表现稳健且具有竞争力。对于功能图谱,其性能持续优于传统特征拼接方法;对结构图谱则保持相当水平。最优模型达到84.71%准确率、86.42%灵敏度、82.89%特异性、84.34%精确率和85.37%F1分数。结果凸显显式建模跨模态交互对多模态神经影像抑郁症分类的重要性。
原文摘要 · Abstract (English)
Major depressive disorder (MDD) is a prevalent mental disorder associated with complex neurobiological changes that cannot be fully captured using a single imaging modality. The use of multimodal magnetic resonance imaging (MRI) provides a more comprehensive understanding of brain changes by combining structural and functional data. Despite this, the effective integration of these modalities remains challenging. In this study, we propose a dual cross-attention-based multimodal fusion framework that explicitly models bidirectional interactions between structural MRI (sMRI) and resting-state functional MRI (rs-fMRI) representations. The proposed approach is tested on the large-scale REST-meta-MDD dataset using both structural and functional brain atlas configurations. Numerous experiments conducted under a 10-fold stratified cross-validation demonstrated that the proposed fusion algorithm achieves robust and competitive performance across all atlas types. The proposed method consistently outperforms conventional feature-level concatenation for functional atlases, while maintaining comparable performance for structural atlases. The most effective dual cross-attention multimodal model obtained 84.71% accuracy, 86.42% sensitivity, 82.89% specificity, 84.34% precision, and 85.37% F1-score. These findings emphasize the importance of explicitly modeling cross-modal interactions for multimodal neuroimaging-based MDD classification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。