用混合架构提升脑影像长程依赖建模,预测更准
BrainMT: A Hybrid Mamba-Transformer Architecture for Modeling Long-Range Dependencies in Functional MRI Data
- Mamba+Transformer双阶段设计,先高效捕获时间全局依赖,再建模空间关系
- 在UKBiobank和HCP数据集上,性别分类与认知能力预测均达顶尖水平
- 适合研究脑功能连接建模、需处理长序列神经影像的科研人员
深度学习的进步使得直接从功能磁共振成像(fMRI)脑体积预测表型特征成为可能,引发神经影像学界广泛关注。然而,现有基于卷积神经网络或Transformer的方法难以捕捉fMRI数据中复杂的长程时空依赖关系。为此,我们提出BrainMT,一种新型混合框架,可高效学习并整合fMRI数据中的长程时空属性。该框架分两阶段运行:(1) 双向Mamba块采用时序优先扫描机制,以计算高效方式捕获全局时间交互;(2) Transformer块利用自注意力机制建模经Mamba处理后的深层特征中的全局空间关系。在两个大规模公开数据集UKBiobank和人类连接组计划(HCP)上的大量实验表明,BrainMT在分类(性别预测)和回归(认知智力预测)任务上均达到当前最优性能,显著优于现有方法。代码与实现细节将公开于https://github.com/arunkumar-kannan/BrainMT-fMRI。
原文摘要 · Abstract (English)
Recent advances in deep learning have made it possible to predict phenotypic measures directly from functional magnetic resonance imaging (fMRI) brain volumes, sparking significant interest in the neuroimaging community. However, existing approaches, primarily based on convolutional neural networks or transformer architectures, often struggle to model the complex relationships inherent in fMRI data, limited by their inability to capture long-range spatial and temporal dependencies. To overcome these shortcomings, we introduce BrainMT, a novel hybrid framework designed to efficiently learn and integrate long-range spatiotemporal attributes in fMRI data. Our framework operates in two stages: (1) a bidirectional Mamba block with a temporal-first scanning mechanism to capture global temporal interactions in a computationally efficient manner; and (2) a transformer block leveraging self-attention to model global spatial relationships across the deep features processed by the Mamba block. Extensive experiments on two large-scale public datasets, UKBioBank and the Human Connectome Project, demonstrate that BrainMT achieves state-of-the-art performance on both classification (sex prediction) and regression (cognitive intelligence prediction) tasks, outperforming existing methods by a significant margin. Our code and implementation details will be made publicly available at this https://github.com/arunkumar-kannan/BrainMT-fMRI
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。