arXiv:2605.20389cs.LGcs.AI2026-05

用神经积分算子建模脑功能影像的时空依赖,提升解码与编码性能。

Nonlocal operator learning for fMRI encoding and decoding tasks

论文配图:Nonlocal operator learning for fMRI encoding and decoding tasks
图 1 · 摘自论文原文
  • 基于隐空间固定点迭代的神经积分算子框架,捕捉非局部时空上下文。
  • 更长时间窗口显著提升解码效果,使潜在空间分类边界更清晰。
  • 适合研究大脑动态建模、脑机接口及高维神经信号分析者参考。

功能性磁共振成像(fMRI)数据具有高维时空结构,给预测与解码带来挑战。本文研究基于神经积分算子的模型在fMRI编码与解码任务中的应用,重点关注非局部时空上下文的作用。我们构建了一个隐空间神经积分算子框架,在辅助空间中进行固定点迭代,并通过解码器完成分类与刺激预测。在两个开源fMRI数据集上评估模型表现,涵盖从fMRI记录中解码刺激以及从刺激表示中编码fMRI动态两个任务。系统比较了短/长时间窗口、视觉皮层与全脑记录的影响,分析其对性能和潜在空间几何结构的影响。结果表明,更长的时间窗口普遍提升性能,生成更具结构性的表征;解码任务中,学习到的潜在空间通常比原始数据提供更清晰的类别分离;编码任务虽绝对性能中等,但更长时间窗口仍持续带来收益。这些发现表明,神经积分算子是建模fMRI动态的有力工具,而更广的时空上下文有助于预测与表征学习。更广泛地,大脑动态中的分布式非局部结构需专门设计的模型架构来捕获。

原文摘要 · Abstract (English)

Functional MRI data exhibit high-dimensional spatiotemporal structure, making both prediction and decoding challenging. In this work, we investigate neural integral-operator-based models for encoding and decoding tasks in fMRI, with particular emphasis on the role of nonlocal spatiotemporal context. We implement a latent neural integral operator framework that performs fixed point iterations in an auxiliary space from which classification and stimuli prediction is performed via a decoder. We evaluate our model on two open-source fMRI datasets. Our experiments examine both decoding of stimuli from fMRI recordings and encoding of fMRI dynamics from stimulus representations. A main focus is the effect of spatiotemporal context: we systematically compare short and long temporal windows, as well as the use of visual cortex vs whole brain recordings, and analyze their influence on performance and latent-space geometry. Across tasks and datasets, larger temporal windows generally improve results and produce more structured learned representations. In decoding experiments, the learned latent space often provides clearer class separation than the raw data. In encoding experiments, although absolute performance remains moderate due to the difficulty of the task, longer temporal windows still yield consistent gains. These findings suggest that neural integral operators provide a promising framework for modeling fMRI dynamics and that broader spatiotemporal context can be beneficial for both prediction and representation learning. More broadly, the results indicate that exploiting distributed nonlocal structure in brain dynamics requires model architectures specifically designed to capture such dependencies.

fMRI积分算子时空建模脑信号解码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。