arXiv:2607.09754cs.CVcs.AI2026-07被引 1

首个支持跨个体零样本行为解码的宽视野钙成像模型

Cross-Subject Modeling for Widefield Calcium Imaging via Atlas-Aligned Spatiotemporal Tokenization

论文配图:Cross-Subject Modeling for Widefield Calcium Imaging via Atlas-Aligned Spatiotemporal Tokenization
图 1 · 摘自论文原文
  • 基于脑图谱对时空数据分块,构建无会话依赖的共享表征
  • 在多数据集上实现跨受试者、跨任务的迁移性能超越单会话模型
  • 首次实现未见受试者的连续行为解码与缺失脑区重建

大规模多受试者宽视野钙成像为全脑皮层动态研究提供了前所未有的机会。然而,高维性、复杂的时空结构以及大量任务无关活动,使得建模工作长期局限于单会话分析,限制了可扩展性与泛化能力。尽管某些神经模态已有跨受试者预训练模型,但宽视野钙成像尚未实现此类模型;更广泛地,跨模态的受试者不变零样本行为解码仍属空白。作为宽视野数据基础建模的初步探索,我们提出WiCAT,一种利用自监督预训练的多受试者模型,不仅能超越单会话模型,还能在未见受试者上实现零样本行为解码。WiCAT采用基于脑图谱的分块策略,不依赖会话特定组件,学习全局共享的时空表示。在多个宽视野数据集上,该模型支持轻量级下游解码,具备跨受试者、跨任务、跨数据集的迁移能力,并显著优于基线模型。尤为关键的是,该模型在未见受试者上实现了稳健的零样本连续行为解码和左除脑区重建。

原文摘要 · Abstract (English)

Large-scale, multi-subject widefield calcium imaging provides unprecedented access to brain-wide cortical dynamics. However, the high dimensionality, complex spatiotemporal structure, and substantial task-irrelevant activity in widefield recordings have largely restricted modeling efforts to single-session analyses, limiting scalability and generalization. While multi-subject pretrained models have been explored for some neural modalities, multi-subject models for widefield calcium imaging have not yet been demonstrated; further, subject-invariant zero-shot behavior decoding remains elusive for multi-subject models across neural modalities more broadly. As a first step toward foundation modeling of widefield data, we introduce WiCAT, a multi-subject model that leverages self-supervised pretraining to both outperform single-session models and enable zero-shot behavior decoding on unseen subjects. WiCAT introduces an atlas-grounded tokenization scheme without session-specific components and learns globally shared spatiotemporal representations. Across multiple widefield datasets, the pretrained model supports lightweight downstream decoding, transfers across subjects, tasks, and datasets, and outperforms baseline models. Notably, the model also achieves robust zero-shot continuous behavior decoding and left-out brain region reconstruction on unseen subjects.

钙成像跨受试者零样本解码自监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。