用动态计算框架构建可解释的脑连接模板,融合多模态认知信息。
Multi-Sensory Cognitive Computing for Learning Population-level Brain Connectivity
- 基于储层计算建模脑信号动态变化,提升可解释性。
- 在多个指标上优于图神经网络方法,且支持多模态输入记忆。
- 适合关注脑功能机制与认知建模的研究者使用。
生成连接性脑模板(CBT)近年来受到广泛关注,因其有望揭示跨个体共享的连接模式。然而,现有方法如传统机器学习和图神经网络(GNNs)存在黑箱性强、计算成本高、仅关注结构拓扑而忽略认知能力等局限。为此,本文提出mCOCO(多感官认知计算)框架,利用储层计算(RC)从BOLD信号中学习群体水平的功能性CBT。RC的动态系统特性使其能追踪状态演变,增强可解释性并建模类脑动态。通过整合文本、音频、视觉等多模态输入,mCOCO不仅捕捉结构拓扑,还建模脑区对感知任务的信息处理与适应能力,计算高效。该框架包含两阶段:(1) 将个体BOLD信号映射至储层,生成个体功能连接组,并聚合为群体级CBT——据我们所知,这是首次在功能连接研究中探索此方法;(2) 通过认知储层引入多模态输入,赋予CBT认知属性。大量实验表明,基于mCOCO的模板在中心性、区分性、拓扑合理性及多模态记忆保留方面显著优于基于GNN的方案。代码已开源:https://github.com/basiralab/mCOCO。
原文摘要 · Abstract (English)
The generation of connectional brain templates (CBTs) has recently garnered significant attention for its potential to identify unique connectivity patterns shared across individuals. However, existing methods for CBT learning such as conventional machine learning and graph neural networks (GNNs) are hindered by several limitations. These include: (i) poor interpretability due to their black-box nature, (ii) high computational cost, and (iii) an exclusive focus on structure and topology, overlooking the cognitive capacity of the generated CBT. To address these challenges, we introduce mCOCO (multi-sensory COgnitive COmputing), a novel framework that leverages Reservoir Computing (RC) to learn population-level functional CBT from BOLD (Blood-Oxygen-level-Dependent) signals. RC's dynamic system properties allow for tracking state changes over time, enhancing interpretability and enabling the modeling of brain-like dynamics, as demonstrated in prior literature. By integrating multi-sensory inputs (e.g., text, audio, and visual data), mCOCO captures not only structure and topology but also how brain regions process information and adapt to cognitive tasks such as sensory processing, all in a computationally efficient manner. Our mCOCO framework consists of two phases: (1) mapping BOLD signals into the reservoir to derive individual functional connectomes, which are then aggregated into a group-level CBT - an approach, to the best of our knowledge, not previously explored in functional connectivity studies - and (2) incorporating multi-sensory inputs through a cognitive reservoir, endowing the CBT with cognitive traits. Extensive evaluations show that our mCOCO-based template significantly outperforms GNN-based CBT in terms of centeredness, discriminativeness, topological soundness, and multi-sensory memory retention. Our source code is available at https://github.com/basiralab/mCOCO.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。