arXiv:2603.20348cs.CV2026-03

构建跨脑图谱的多视角脑网络模型,提升泛化与可扩展性。

Toward a Multi-View Brain Network Foundation Model: Cross-View Consistency Learning Across Arbitrary Atlases

  • 引入解剖距离指导Transformer建模,增强区域间交互
  • 通过无监督跨视图一致性学习对齐不同图谱表示
  • 支持多数据集联合预训练,适合脑网络分析研究者

脑网络分析为描述脑组织结构提供了可解释的框架,广泛应用于神经疾病识别。近年来自监督学习推动了脑网络基础模型的发展,但现有方法常受限于图谱依赖、多视角信息利用不足及解剖先验融合弱。本文提出MV-BrainFM,一种多视角脑网络基础模型,可从任意图谱构建的脑网络中学习通用且可扩展的表征。该模型显式将解剖距离信息融入Transformer建模以引导区域间交互,并提出无监督跨视图一致性学习策略,在共享潜在空间中对齐同一受试者不同图谱的表示。预训练阶段联合强化视图内鲁棒性与跨视图对齐,有效捕捉异构视图间的互补信息,同时保持图谱感知能力。此外,MV-BrainFM采用统一多视图预训练范式,可同时处理多个数据集与图谱,相比传统串行训练显著提升计算效率。框架具备强可扩展性,在增加数据多样性时持续获益,且在未见图谱配置下表现稳定。在17个fMRI数据集共2万余名受试者的实验中,MV-BrainFM在单图谱与多图谱设置下均优于14种现有脑网络基础模型及任务特定基线。

原文摘要 · Abstract (English)

Brain network analysis provides an interpretable framework for characterizing brain organization and has been widely used for neurological disorder identification. Recent advances in self-supervised learning have motivated the development of brain network foundation models. However, existing approaches are often limited by atlas dependency, insufficient exploitation of multiple network views, and weak incorporation of anatomical priors. In this work, we propose MV-BrainFM, a multi-view brain network foundation model designed to learn generalizable and scalable representations from brain networks constructed with arbitrary atlases. MV-BrainFM explicitly incorporates anatomical distance information into Transformer-based modeling to guide inter-regional interactions, and introduces an unsupervised cross-view consistency learning strategy to align representations from multiple atlases of the same subject in a shared latent space. By jointly enforcing within-view robustness and cross-view alignment during pretraining, the model effectively captures complementary information across heterogeneous network views while remaining atlas-aware. In addition, MV-BrainFM adopts a unified multi-view pretraining paradigm that enables simultaneous learning from multiple datasets and atlases, significantly improving computational efficiency compared to conventional sequential training strategies. The proposed framework also demonstrates strong scalability, consistently benefiting from increasing data diversity while maintaining stable performance across unseen atlas configurations. Extensive experiments on more than 20K subjects from 17 fMRI datasets show that MV-BrainFM consistently outperforms 14 existing brain network foundation models and task-specific baselines under both single-atlas and multi-atlas settings.

脑网络多视角学习自监督基础模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。