用语言和空间先验生成未知认知任务的脑活动,支持虚拟神经科学实验设计。
Flow Matching with In-Context Priors for Out-of-Distribution Brain Dynamics

- 每时刻条件化扩散变换器,结合语言与空间先验生成全脑fMRI动态。
- 仅用语言即可恢复区域特异性激活模式,空间先验提升在模糊区域的生成质量。
- 首次实现对未见认知任务的全脑脑活动零样本生成,适合神经科学实验设计者。
流匹配与扩散模型已广泛应用于图像到蛋白质等领域的条件生成,并扩展至分布外情境。然而,神经时间序列的生成模型仍多局限于类别条件,难以实现组合性与零样本泛化。本文提出一种逐时刻条件化的扩散变换器,通过在上下文中注入组合性语言与可选的空间先验,生成未知认知任务下的真实fMRI脑动态。该零样本生成能力可支持虚拟神经科学研究,实现新认知实验的仿真设计与评估。基于该模型,我们在数百个保留的任务条件下进行评估,分析其预测性能与训练流形的关系。仅使用语言时,模型能恢复任务间的区域特异性招募及保留的空间激活模式;当提供空间先验时,可在语言路径失效的区域锚定生成,同时保持组合结构以支持反事实任务设定。据我们所知,这是首个针对未见认知任务的全皮层fMRI动态生成模型,推动了反事实神经科学与数据驱动实验设计的发展。
原文摘要 · Abstract (English)
Flow matching and diffusion models enable conditional generation across domains ranging from images to proteins, with recent extensions to out-of-distribution contexts. Yet generative models of neural time series have largely remained restricted to categorical conditioning, precluding compositional and zero-shot generalization. In this work, we propose a per-timestep conditioned diffusion transformer for generating realistic fMRI brain dynamics during unseen cognitive tasks by injecting both compositional language and optional spatial priors in-context. Such zero-shot generation could enable counterfactual neuroscience by supporting in-silico design and evaluation of novel cognitive experiments before empirical validation. Leveraging this model, we evaluate across hundreds of held-out task conditions and characterize predictive performance in relation to the training manifold. From language alone, the model recovers region-specific recruitment across tasks and held-out spatial activation patterns. Spatial priors, when available, complement the text pathway by anchoring generation in regions of task space where language alone degrades, while retaining the compositional structure needed for counterfactual task specification. To our knowledge this is the first generative model of whole-cortex fMRI dynamics for unseen cognitive tasks, advancing counterfactual neuroscience and data-driven experimental design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。