将神经活动预测转为分类任务,提升小鼠视觉皮层信号的预测精度。
QuantFormer: Learning to Quantize for Neural Activity Forecasting in Mouse Visual Cortex
- 用动态量化将预测转为分类,更好捕捉稀疏神经激活模式。
- 在艾伦数据集上实现跨刺激与个体的强泛化性能。
- 支持任意数量神经元,适合大规模神经信号建模。
理解复杂动物行为依赖于解析脑回路中的神经活动模式,因此预测神经活动对构建脑动力学预测模型至关重要,尤其在实时光遗传干预中具有重要价值。传统编码解码方法聚焦于解释过去数据,而神经预测旨在预示未来神经活动,因神经信号具有时空稀疏性和复杂依赖性,面临独特挑战。现有基于Transformer的方法难以有效捕捉此类特性。为此,本文提出QuantFormer,一种专为两光子钙成像数据设计的Transformer模型,通过动态信号量化将预测任务重构为分类问题,更有效地学习稀疏激活模式。同时,引入神经元特异性标记,实现对任意数量神经元的多变量信号分析,具备良好可扩展性。在艾伦研究所数据集上进行无监督量化训练后,QuantFormer在小鼠视觉皮层活动预测中达到新基准,表现出跨刺激和个体的鲁棒性能与泛化能力,为神经信号预测奠定基础模型。
原文摘要 · Abstract (English)
Understanding complex animal behaviors hinges on deciphering the neural activity patterns within brain circuits, making the ability to forecast neural activity crucial for developing predictive models of brain dynamics. This capability holds immense value for neuroscience, particularly in applications such as real-time optogenetic interventions. While traditional encoding and decoding methods have been used to map external variables to neural activity and vice versa, they focus on interpreting past data. In contrast, neural forecasting aims to predict future neural activity, presenting a unique and challenging task due to the spatiotemporal sparsity and complex dependencies of neural signals. Existing transformer-based forecasting methods, while effective in many domains, struggle to capture the distinctiveness of neural signals characterized by spatiotemporal sparsity and intricate dependencies. To address this challenge, we here introduce QuantFormer, a transformer-based model specifically designed for forecasting neural activity from two-photon calcium imaging data. Unlike conventional regression-based approaches, QuantFormerreframes the forecasting task as a classification problem via dynamic signal quantization, enabling more effective learning of sparse neural activation patterns. Additionally, QuantFormer tackles the challenge of analyzing multivariate signals from an arbitrary number of neurons by incorporating neuron-specific tokens, allowing scalability across diverse neuronal populations. Trained with unsupervised quantization on the Allen dataset, QuantFormer sets a new benchmark in forecasting mouse visual cortex activity. It demonstrates robust performance and generalization across various stimuli and individuals, paving the way for a foundational model in neural signal prediction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。