arXiv:2410.13872cs.NEcs.LG2024-10ICLR被引 5

用行为信息训练神经模型,推理时仅靠脑电数据也能精准预测行为。

BLEND: Behavior-guided Neural Population Dynamics Modeling via Privileged Knowledge Distillation

  • 训练时融合行为与脑电数据,推理时只用脑电数据
  • 行为解码准确率提升超50%,基因身份预测提升超15%
  • 不依赖特定模型结构,适配现有神经动力学框架

建模神经元群体的非线性动态是计算神经科学的核心目标。近年来研究趋向联合建模神经活动与行为以揭示其关联,但现有方法常需复杂模型或简化假设。由于真实场景中往往缺乏完美的神经-行为配对数据,一个关键却未被充分探讨的问题浮现:如何在推理时仅使用神经活动输入的前提下,仍能利用训练阶段的行为信号提升性能?为此,我们提出BLEND——一种基于特权知识蒸馏的行为引导神经群体动力学建模框架。将行为视为特权信息,训练一个教师模型,同时输入行为观测(特权特征)和神经活动(常规特征);随后,仅用神经活动蒸馏出学生模型。与现有方法不同,该框架具有模型无关性,无需强加行为与神经活动之间的关系假设,可无缝增强现有神经动力学模型架构,无需从头构建专用模型。在神经群体活动建模和转录组神经元身份预测任务上的大量实验表明,经过行为引导蒸馏后,行为解码性能提升超过50%,转录组神经元身份预测准确率提升超过15%。此外,我们还系统探索了多种行为引导蒸馏策略,并对不同策略对模型性能的影响进行了全面分析。

原文摘要 · Abstract (English)

Modeling the nonlinear dynamics of neuronal populations represents a key pursuit in computational neuroscience. Recent research has increasingly focused on jointly modeling neural activity and behavior to unravel their interconnections. Despite significant efforts, these approaches often necessitate either intricate model designs or oversimplified assumptions. Given the frequent absence of perfectly paired neural-behavioral datasets in real-world scenarios when deploying these models, a critical yet understudied research question emerges: how to develop a model that performs well using only neural activity as input at inference, while benefiting from the insights gained from behavioral signals during training? To this end, we propose BLEND, the behavior-guided neural population dynamics modeling framework via privileged knowledge distillation. By considering behavior as privileged information, we train a teacher model that takes both behavior observations (privileged features) and neural activities (regular features) as inputs. A student model is then distilled using only neural activity. Unlike existing methods, our framework is model-agnostic and avoids making strong assumptions about the relationship between behavior and neural activity. This allows BLEND to enhance existing neural dynamics modeling architectures without developing specialized models from scratch. Extensive experiments across neural population activity modeling and transcriptomic neuron identity prediction tasks demonstrate strong capabilities of BLEND, reporting over 50% improvement in behavioral decoding and over 15% improvement in transcriptomic neuron identity prediction after behavior-guided distillation. Furthermore, we empirically explore various behavior-guided distillation strategies within the BLEND framework and present a comprehensive analysis of effectiveness and implications for model performance.

神经建模知识蒸馏行为预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。