用跨注意力融合功能与结构脑图数据,提升自闭症分类准确率。
Multimodal Connectome Fusion via Cross-Attention for Autism Spectrum Disorder Classification Using Graph Learning
- 基于异构图学习框架,以功能连接为主导融合结构与表型信息。
- 在ABIDE-I数据集上达87.3% AUC和84.4%准确率,跨站点性能优。
- 适合关注多模态脑影像融合与自闭症自动诊断的研究者。
自闭症谱系障碍(ASD)是一种复杂的神经发育疾病,表现为功能脑连接异常和细微的结构改变。静息态功能性磁共振成像(rs-fMRI)广泛用于识别大规模脑网络的紊乱,而结构磁共振成像(sMRI)则提供形态组织的补充信息。尽管两者具有互补性,但在统一框架中有效整合这些异构影像模态仍具挑战。本研究提出一种多模态图学习框架,保持功能连接的主导地位,同时融合结构影像和表型信息用于ASD分类。在ABIDE-I数据集上,每个受试者作为群体图中的节点,功能与结构特征作为模态特异性节点属性,个体间关系通过基于表型信息的成对关联编码器(PAE)建模。训练两个边缘变分图卷积网络(Edge Variational GCNs)学习个体级嵌入。为实现有效多模态融合,引入一种新颖的非对称变压器式跨注意力机制,使功能嵌入可选择性地吸收互补的结构信息,同时保持功能主导性。融合后的嵌入送入MLP进行ASD分类。采用分层10折交叉验证,模型达到87.3% AUC和84.4%准确率;在留一中心交叉验证(LOSO-CV)下,平均跨站点准确率为82.0%,分别优于现有方法约3%(10折)和7%(LOSO-CV)。该框架有效整合来自多中心的异构多模态数据,提升了跨站点自动化ASD分类性能。
原文摘要 · Abstract (English)
Autism spectrum disorder (ASD) is a complex neurodevelopmental condition characterized by atypical functional brain connectivity and subtle structural alterations. rs-fMRI has been widely used to identify disruptions in large-scale brain networks, while structural MRI provides complementary information about morphological organization. Despite their complementary nature, effectively integrating these heterogeneous imaging modalities within a unified framework remains challenging. This study proposes a multimodal graph learning framework that preserves the dominant role of functional connectivity while integrating structural imaging and phenotypic information for ASD classification. The proposed framework is evaluated on ABIDE-I dataset. Each subject is represented as a node within a population graph. Functional and structural features are extracted as modality-specific node attributes, while inter-subject relationships are modeled using a pairwise association encoder (PAE) based on phenotypic information. Two Edge Variational GCNs are trained to learn subject-level embeddings. To enable effective multimodal integration, we introduce a novel asymmetric transformer-based cross-attention mechanism that allows functional embeddings to selectively incorporate complementary structural information while preserving functional dominance. The fused embeddings are then passed to a MLP for ASD classification. Using stratified 10-fold cross-validation, the framework achieved an AUC of 87.3% and an accuracy of 84.4%. Under leave-one-site-out cross-validation (LOSO-CV), the model achieved an average cross-site accuracy of 82.0%, outperforming existing methods by approximately 3% under 10-fold cross-validation and 7% under LOSO-CV. The proposed framework effectively integrates heterogeneous multimodal data from the multi-site ABIDE-I dataset, improving automated ASD classification across imaging sites.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。