arXiv:2501.07055cs.CVcs.LG2025-01被引 5

用GAN实现脑结构与功能连接图双向生成,提升建模精度。

SFC-GAN: A Generative Adversarial Network for Brain Functional and Structural Connectome Translation

  • 基于CycleGAN架构,融合卷积层捕捉脑网络空间结构
  • 引入结构保持损失,确保翻译后连接图拓扑对称性
  • 支持单模态输入下双向生成,适合数据缺失场景

现代脑成像技术可分别通过扩散MRI和功能MRI重建人脑的结构连接(SC)与功能连接(FC)。理解二者关系对揭示脑功能与组织机制至关重要。但同时获取两种模态仍具挑战,限制了全面分析。现有深度生成模型多仅生成单一模态或实现单向转换,未能发挥双向转换优势,尤其在仅有一类连接图可用时。为此,我们提出结构-功能连接图生成对抗网络(SFC-GAN),一种双向翻译框架。该方法采用CycleGAN架构,结合卷积层有效捕捉脑连接图的空间结构;为保持连接图的拓扑完整性,引入结构保持损失,引导模型同时学习全局与局部模式并维持对称性。实验表明,该框架在翻译质量、相似性及图属性评估上优于基线模型,且生成的每种模态均可有效用于下游分类任务。

原文摘要 · Abstract (English)

Modern brain imaging technologies have enabled the detailed reconstruction of human brain connectomes, capturing structural connectivity (SC) from diffusion MRI and functional connectivity (FC) from functional MRI. Understanding the intricate relationships between SC and FC is vital for gaining deeper insights into the brain's functional and organizational mechanisms. However, obtaining both SC and FC modalities simultaneously remains challenging, hindering comprehensive analyses. Existing deep generative models typically focus on synthesizing a single modality or unidirectional translation between FC and SC, thereby missing the potential benefits of bi-directional translation, especially in scenarios where only one connectome is available. Therefore, we propose Structural-Functional Connectivity GAN (SFC-GAN), a novel framework for bidirectional translation between SC and FC. This approach leverages the CycleGAN architecture, incorporating convolutional layers to effectively capture the spatial structures of brain connectomes. To preserve the topological integrity of these connectomes, we employ a structure-preserving loss that guides the model in capturing both global and local connectome patterns while maintaining symmetry. Our framework demonstrates superior performance in translating between SC and FC, outperforming baseline models in similarity and graph property evaluations compared to ground truth data, each translated modality can be effectively utilized for downstream classification.

生成模型脑连接图双向翻译

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。