arXiv:2603.10253cs.CVcs.AI2026-03

通过跨视图对比对齐,联合学习脑影像与区域图表示,提升疾病分类效果。

Joint Imaging-ROI Representation Learning via Cross-View Contrastive Alignment for Brain Disorder Classification

  • 设计双向对比目标,对齐个体级全脑与区域图嵌入
  • 在ADHD-200和ABIDE数据集上,联合模型优于单一模态
  • 揭示两种表示互补性,适合脑疾病分类研究者参考

脑影像分类通常从两个角度入手:建模整个图像体积以捕捉全局解剖上下文,或构建基于感兴趣区(ROI)的图结构来编码局部及拓扑交互。尽管两者各自表现有效,但其相对贡献与潜在互补性仍不明确。现有融合方法多为特定任务设计,无法在一致训练设置下系统评估各表示。为此,我们提出统一的跨视图对比框架,实现联合影像-ROI表征学习。该方法学习个体级全局(影像)与局部(ROI图)嵌入,并通过双向对比目标将其对齐至共享潜在空间,促使同主体表示收敛、异主体分离。此对齐生成可比嵌入,适用于下游融合,并支持在统一训练协议中系统评估仅影像、仅ROI及联合配置的表现。在ADHD-200和ABIDE数据集上的大量实验表明,联合学习在多种骨干网络下均持续优于单一分支。可解释性分析显示,影像分支与ROI分支强调不同但互补的判别模式,解释了性能提升。这些发现为显式整合全局体素与ROI级表示提供了原则性证据,是神经影像学脑疾病分类的可行方向。源代码见 https://anonymous.4open.science/r/imaging-roi-contrastive-152C/。

原文摘要 · Abstract (English)

Brain imaging classification is commonly approached from two perspectives: modeling the full image volume to capture global anatomical context, or constructing ROI-based graphs to encode localized and topological interactions. Although both representations have demonstrated independent efficacy, their relative contributions and potential complementarity remain insufficiently understood. Existing fusion approaches are typically task-specific and do not enable controlled evaluation of each representation under consistent training settings. To address this gap, we propose a unified cross-view contrastive framework for joint imaging-ROI representation learning. Our method learns subject-level global (imaging) and local (ROI-graph) embeddings and aligns them in a shared latent space using a bidirectional contrastive objective, encouraging representations from the same subject to converge while separating those from different subjects. This alignment produces comparable embeddings suitable for downstream fusion and enables systematic evaluation of imaging-only, ROI-only, and joint configurations within a unified training protocol. Extensive experiments on the ADHD-200 and ABIDE datasets demonstrate that joint learning consistently improves classification performance over either branch alone across multiple backbone choices. Moreover, interpretability analyses reveal that imaging-based and ROI-based branches emphasize distinct yet complementary discriminative patterns, explaining the observed performance gains. These findings provide principled evidence that explicitly integrating global volumetric and ROI-level representations is a promising direction for neuroimaging-based brain disorder classification. The source code is available at https://anonymous.4open.science/r/imaging-roi-contrastive-152C/.

脑疾病分类对比学习多模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。