用对比学习提升脑网络模型,准确识别神经退行性疾病。
Contrasformer: A Brain Network Contrastive Transformer for Neurodegenerative Condition Identification
- 设计双流注意力机制生成先验增强的对比图,缓解群体分布偏移。
- 引入节点身份嵌入与三重辅助损失,提升疾病特征识别精度。
- 在4种疾病数据集上提升超10%,适合神经科学与医学影像研究者。
理解神经疾病是神经科学的基础问题,通常需分析功能磁共振成像(fMRI)数据构建的脑网络。尽管图神经网络(GNN)和图变压器在多个领域广泛应用,但应用于脑网络时面临挑战:数据受子群体间分布偏移噪声影响严重,且忽略节点身份,阻碍疾病特异性模式识别。为此,我们提出Contrasformer,一种新型对比脑网络变压器。它通过双流注意力机制生成先验知识增强的对比图,缓解子群体间的分布偏移;利用带身份嵌入的跨注意力机制突出节点身份,并设置三种辅助损失确保组一致性。在4个功能脑网络数据集、覆盖4种不同疾病上的评估显示,Contrasformer相比现有最先进方法最高提升10.8%的准确率,验证了其在神经疾病识别中的有效性。案例研究展示了其可解释性,尤其对神经科学具有价值。代码已公开于https://github.com/AngusMonroe/Contrasformer。
原文摘要 · Abstract (English)
Understanding neurological disorder is a fundamental problem in neuroscience, which often requires the analysis of brain networks derived from functional magnetic resonance imaging (fMRI) data. Despite the prevalence of Graph Neural Networks (GNNs) and Graph Transformers in various domains, applying them to brain networks faces challenges. Specifically, the datasets are severely impacted by the noises caused by distribution shifts across sub-populations and the neglect of node identities, both obstruct the identification of disease-specific patterns. To tackle these challenges, we propose Contrasformer, a novel contrastive brain network Transformer. It generates a prior-knowledge-enhanced contrast graph to address the distribution shifts across sub-populations by a two-stream attention mechanism. A cross attention with identity embedding highlights the identity of nodes, and three auxiliary losses ensure group consistency. Evaluated on 4 functional brain network datasets over 4 different diseases, Contrasformer outperforms the state-of-the-art methods for brain networks by achieving up to 10.8\% improvement in accuracy, which demonstrates its efficacy in neurological disorder identification. Case studies illustrate its interpretability, especially in the context of neuroscience. This paper provides a solution for analyzing brain networks, offering valuable insights into neurological disorders. Our code is available at \url{https://github.com/AngusMonroe/Contrasformer}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。