arXiv:2512.12461cs.LGcs.AI2025-12NeurIPS被引 4

用尖峰信号知识蒸馏提升脑电图建模精度

Cross-Modal Representational Knowledge Distillation for Enhanced Spike-Informed LFP Modeling

  • 用多会话尖峰模型做教师,蒸馏知识到脑电图学生模型
  • 蒸馏后模型在无监督和有监督下均超越基线,跨会话泛化能力强
  • 适合神经接口、脑机交互等需要稳定脑信号建模的研究

皮层内神经实验中,局部场电位(LFP)常与尖峰活动同步记录,能反映更大时空尺度的脑活动,具有长期稳定性好、抗电极退化、功耗低等实际优势。然而,由于其群体平均特性,传统建模方法难以发挥其潜力,导致对运动行为等下游任务的预测能力较弱。为此,本文提出一种跨模态知识蒸馏框架,将预训练多会话尖峰变换器模型中的高保真表示知识迁移至LFP变换器模型。首先,基于会话特定的神经标记策略,使用掩码自编码目标训练教师尖峰模型;随后,对齐学生LFP模型的隐状态表示与教师尖峰模型。结果表明,蒸馏后的LFP模型在完全无监督和有监督设置下均显著优于单/多会话基线模型,并可在无需再蒸馏的情况下泛化至新会话,同时保持优异性能。这些发现证明,跨模态知识蒸馏是利用高性能尖峰模型构建更精准LFP模型的强大且可扩展的方法。

原文摘要 · Abstract (English)

Local field potentials (LFPs) can be routinely recorded alongside spiking activity in intracortical neural experiments, measure a larger complementary spatiotemporal scale of brain activity for scientific inquiry, and can offer practical advantages over spikes, including greater long-term stability, robustness to electrode degradation, and lower power requirements. Despite these advantages, recent neural modeling frameworks have largely focused on spiking activity since LFP signals pose inherent modeling challenges due to their aggregate, population-level nature, often leading to lower predictive power for downstream task variables such as motor behavior. To address this challenge, we introduce a cross-modal knowledge distillation framework that transfers high-fidelity representational knowledge from pretrained multi-session spike transformer models to LFP transformer models. Specifically, we first train a teacher spike model across multiple recording sessions using a masked autoencoding objective with a session-specific neural tokenization strategy. We then align the latent representations of the student LFP model to those of the teacher spike model. Our results show that the Distilled LFP models consistently outperform single- and multi-session LFP baselines in both fully unsupervised and supervised settings, and can generalize to other sessions without additional distillation while maintaining superior performance. These findings demonstrate that cross-modal knowledge distillation is a powerful and scalable approach for leveraging high-performing spike models to develop more accurate LFP models.

神经建模知识蒸馏脑电图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。