用Mamba和语言模型动态分析自闭症脑功能连接,生成可解释报告
NeuroMambaLLM: Dynamic Graph Learning of fMRI Functional Connectivity in Autistic Brains Using Mamba and Language Model Reasoning
- 从原始fMRI数据动态学习脑功能连接图,替代静态相关图
- 融合Mamba捕捉长时序依赖,通过LoRA微调实现高效推理
- 可输出诊断分类与临床可读文本报告,适合医学AI研究者
大型语言模型(LLMs)在多模态语义推理中表现强劲,但其与脑连接图模型的结合仍有限。现有大多数fMRI分析方法依赖静态功能连接(FC)表征,忽略了自闭症等神经发育障碍中关键的瞬态神经动态。近期的状态空间方法(如Mamba)能高效建模时间结构,但通常仅作为独立特征提取器使用,缺乏高层推理能力。本文提出NeuroMambaLLM,一种端到端框架,整合动态潜在图学习、选择性状态空间时间建模与语言模型推理。该方法从原始血氧水平依赖(BOLD)时间序列中动态学习功能连接,以自适应潜在连接取代固定相关图,抑制运动伪影并捕捉长程时间依赖。生成的动态脑表示被投影至语言模型嵌入空间,基础语言模型保持冻结,仅训练轻量级低秩适配(LoRA)模块以实现参数高效对齐。该设计使语言模型能同时完成诊断分类与基于语言的推理,分析动态fMRI模式并生成具有临床意义的文本报告。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have demonstrated strong semantic reasoning across multimodal domains. However, their integration with graph-based models of brain connectivity remains limited. In addition, most existing fMRI analysis methods rely on static Functional Connectivity (FC) representations, which obscure transient neural dynamics critical for neurodevelopmental disorders such as autism. Recent state-space approaches, including Mamba, model temporal structure efficiently, but are typically used as standalone feature extractors without explicit high-level reasoning. We propose NeuroMambaLLM, an end-to-end framework that integrates dynamic latent graph learning and selective state-space temporal modelling with LLMs. The proposed method learns the functional connectivity dynamically from raw Blood-Oxygen-Level-Dependent (BOLD) time series, replacing fixed correlation graphs with adaptive latent connectivity while suppressing motion-related artifacts and capturing long-range temporal dependencies. The resulting dynamic brain representations are projected into the embedding space of an LLM model, where the base language model remains frozen and lightweight low-rank adaptation (LoRA) modules are trained for parameter-efficient alignment. This design enables the LLM to perform both diagnostic classification and language-based reasoning, allowing it to analyze dynamic fMRI patterns and generate clinically meaningful textual reports.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。