用知识蒸馏让大脑接口模型更小更快,适合植入设备
BrainDistill: Implantable Motor Decoding with Task-Specific Knowledge Distillation
- 用任务特异性蒸馏保留关键解码特征
- 小样本校准下性能超越现有方法
- 支持纯整数运算,功耗极低适合植入
基于Transformer的大参数神经解码器在脑机接口任务中表现优于传统模型,但其高算力需求限制了在功耗受限的植入式系统中的部署。为此,我们提出BrainDistill,一种集成植入式神经解码器(IND)与任务特异性知识蒸馏(TSKD)框架的新管道。不同于传统特征蒸馏全面保留教师模型表示,TSKD通过有监督投影显式优先保留对解码至关重要的特征。在多个神经数据集上,IND在运动解码任务中持续优于先前解码器,其经TSKD蒸馏的变体在少样本校准设置下进一步超越其他蒸馏方法。最后,我们设计了一种量化感知训练方案,使模型支持仅整数推理,激活裁剪范围在训练中学习。量化后的IND可在植入式BCI的严格功耗约束下部署,性能损失极小。
原文摘要 · Abstract (English)
Transformer-based neural decoders with large parameter counts, pre-trained on large-scale datasets, have recently outperformed classical machine learning models and small neural networks on brain-computer interface (BCI) tasks. However, their large parameter counts and high computational demands hinder deployment in power-constrained implantable systems. To address this challenge, we introduce BrainDistill, a novel implantable motor decoding pipeline that integrates an implantable neural decoder (IND) with a task-specific knowledge distillation (TSKD) framework. Unlike standard feature distillation methods that attempt to preserve teacher representations in full, TSKD explicitly prioritizes features critical for decoding through supervised projection. Across multiple neural datasets, IND consistently outperforms prior neural decoders on motor decoding tasks, while its TSKD-distilled variant further surpasses alternative distillation methods in few-shot calibration settings. Finally, we present a quantization-aware training scheme that enables integer-only inference with activation clipping ranges learned during training. The quantized IND enables deployment under the strict power constraints of implantable BCIs with minimal performance loss.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。