无需共用刺激数据,实现跨被试神经活动对齐。
Task-guided cross-subject latent alignment: a multi-encoder-decoder VAE

- 用预训练ANN构建公共框架,引导多编码器解码器变分自编码器对齐
- 在自然场景数据上实现更优语义组织与跨被试对齐效果
- 适合神经科学中无共享刺激的跨被试建模与图像重建任务
跨被试神经活动对齐有望揭示共享计算原理并构建通用解码器。然而传统方法需被试间共享刺激,限制了其在自然情景下数据重叠有限或无重叠时的应用。本文提出多编码器-解码器变分自编码器(MED-VAE),通过预训练人工神经网络(ANN)提供的公共结构锚定表示,实现无需共享刺激的跨被试对齐。在自然场景数据集(Natural Scenes Dataset)上,MED-VAE构建的共同潜在空间具有更优的语义组织,跨被试对齐性能优于现有方法,且在未见刺激下仍保持鲁棒泛化能力。从共同空间重构回各被试原始神经空间时,保留了等量的刺激驱动信号。最终,该优越对齐直接支持跨被试神经预测,如跨被试图像解码。本研究提出一个可识别通用共同子空间的框架,适用于视觉皮层对静态图像响应的跨被试预测与下游任务。
原文摘要 · Abstract (English)
Aligning neural activity across subjects offers the promise of discovering shared computational principles and generalizable decoders. However, traditional alignment methods require shared stimuli across subjects, a constraint that limits applicability to naturalistic paradigms with limited or non-overlapping data. We introduce a Multi-Encoder-Decoder Variational Autoencoder (MED-VAE) that achieves cross-subject alignment without shared stimuli by anchoring representations to a common scaffold provided by a pretrained ANN. Using the Natural Scenes Dataset, we show that MED-VAE creates common latent spaces with superior semantic organisation, achieving higher cross-subject alignment than common methods while maintaining robust generalisation to held-out stimuli where traditional methods degrade. Reconstructing from these common spaces back to each subject's original neural space, MED-VAE preserves equal stimulus-driven signal in its cross-subject latent space. Finally, we show that this superior alignment directly enables cross-subject neural prediction, as demonstrated via cross-subject image decoding. In summary, we introduce a framework to identify generalisable common subspaces for cross-subject predictions and downstream tasks, demonstrated here for visual cortex responses to static images.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。