arXiv:2510.07342q-bio.NCcs.LG2025-10被引 1

用连续函数建模大脑对图像的响应,突破传统网格限制。

Beyond Grid-Locked Voxels: Neural Response Functions for Continuous Brain Encoding

  • 将脑响应建模为标准化空间中的连续函数,不依赖固定体素网格。
  • 在跨被试适应中表现更优,所需数据量减少数个数量级。
  • 适合研究脑成像数据高效建模与跨个体泛化问题。

神经编码模型旨在预测自然图像刺激下功能磁共振(fMRI)记录的大脑反应。传统方法将三维体素数据展平为一维向量,忽略空间上下文与解剖信息,且模型绑定于特定被试的体素网格。本文提出神经响应函数(NRF),将脑活动建模为标准化MNI空间上的连续函数:给定图像与空间坐标(x, y, z),模型可预测该位置的响应。该框架解耦了预测与训练网格,支持任意空间分辨率查询,实现分辨率无关分析。通过基于解剖空间建模,NRF利用大脑响应的两大特性:(1) 局部平滑性——邻近体素响应模式相似,连续建模能捕捉相关性并提升数据效率;(2) 跨被试对齐性——使用MNI坐标统一个体间数据,使预训练模型可在新被试上微调。实验表明,NRF在被试内编码与跨被试适配任务中均优于基线模型,性能优异的同时大幅降低数据需求。据我们所知,NRF是首个突破体素展平范式的解剖感知编码模型,首次实现了从图像到三维脑响应的连续映射。

原文摘要 · Abstract (English)

Neural encoding models aim to predict fMRI-measured brain responses to natural images. fMRI data is acquired as a 3D volume of voxels, where each voxel has a defined spatial location in the brain. However, conventional encoding models often flatten this volume into a 1D vector and treat voxel responses as independent outputs. This removes spatial context, discards anatomical information, and ties each model to a subject-specific voxel grid. We introduce the Neural Response Function (NRF), a framework that models fMRI activity as a continuous function over anatomical space rather than a flat vector of voxels. NRF represents brain activity as a continuous implicit function: given an image and a spatial coordinate (x, y, z) in standardized MNI space, the model predicts the response at that location. This formulation decouples predictions from the training grid, supports querying at arbitrary spatial resolutions, and enables resolution-agnostic analyses. By grounding the model in anatomical space, NRF exploits two key properties of brain responses: (1) local smoothness -- neighboring voxels exhibit similar response patterns; modeling responses continuously captures these correlations and improves data efficiency, and (2) cross-subject alignment -- MNI coordinates unify data across individuals, allowing a model pretrained on one subject to be fine-tuned on new subjects. In experiments, NRF outperformed baseline models in both intrasubject encoding and cross-subject adaptation, achieving high performance while reducing the data size needed by orders of magnitude. To our knowledge, NRF is the first anatomically aware encoding model to move beyond flattened voxels, learning a continuous mapping from images to brain responses in 3D space.

脑机接口fMRI建模连续函数跨被试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。