arXiv:2603.24176eess.IVcs.CV2026-03

用脑电图重建高分辨率脑动态影像,实现时空一致的连续脑活动序列。

Modeling Spatiotemporal Neural Frames for High Resolution Brain Dynamic

  • 结合脑电图与功能磁共振,以脑电为条件重建连续脑活动序列。
  • 在CineBrain数据集上实现全脑与功能区域的高精度重建和强时序一致性。
  • 适用于真实不规则采样场景,适合神经科学与脑机接口研究者。

捕捉动态时空神经活动对理解大规模脑机制至关重要。功能磁共振成像(fMRI)提供高分辨率皮层表征,是刻画精细脑活动模式的坚实基础。然而fMRI高采集成本限制了其大规模应用,因此高质量fMRI重建成为关键任务。脑电图(EEG)可提供毫秒级时间线索,与fMRI互补。基于此互补性,我们提出一种脑电条件框架,将动态fMRI重构为具有高空间保真度和强时间一致性的皮层顶点级连续神经序列。为应对真实fMRI采集中的采样不规则问题,引入零空间中间帧重建机制,实现任意中间帧的测量一致补全,提升序列连续性与实际可用性。在CineBrain数据集上的实验表明,该方法在全脑及功能特异性区域均实现优异体素级重建质量与鲁棒时间一致性。重建的fMRI还保留了关键功能信息,支持下游视觉解码任务。本工作为从脑电图估计高分辨率脑动态提供了新路径,推动多模态神经成像向更动态的脑活动建模发展。

原文摘要 · Abstract (English)

Capturing dynamic spatiotemporal neural activity is essential for understanding large-scale brain mechanisms. Functional magnetic resonance imaging (fMRI) provides high-resolution cortical representations that form a strong basis for characterizing fine-grained brain activity patterns. The high acquisition cost of fMRI limits large-scale applications, therefore making high-quality fMRI reconstruction a crucial task. Electroencephalography (EEG) offers millisecond-level temporal cues that complement fMRI. Leveraging this complementarity, we present an EEG-conditioned framework for reconstructing dynamic fMRI as continuous neural sequences with high spatial fidelity and strong temporal coherence at the cortical-vertex level. To address sampling irregularities common in real fMRI acquisitions, we incorporate a null-space intermediate-frame reconstruction, enabling measurement-consistent completion of arbitrary intermediate frames and improving sequence continuity and practical applicability. Experiments on the CineBrain dataset demonstrate superior voxel-wise reconstruction quality and robust temporal consistency across whole-brain and functionally specific regions. The reconstructed fMRI also preserves essential functional information, supporting downstream visual decoding tasks. This work provides a new pathway for estimating high-resolution fMRI dynamics from EEG and advances multimodal neuroimaging toward more dynamic brain activity modeling.

脑机接口多模态融合动态建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。