arXiv:2606.04040cs.SDcs.AI2026-06

针对脑电音乐重建中信号微弱易失的问题,提出保留电极特性的新设计。

Channel-Oriented Design for EEG-to-Music Reconstruction

论文配图:Channel-Oriented Design for EEG-to-Music Reconstruction
图 1 · 摘自论文原文
  • 按电极分块处理,保留空间局部神经信息
  • 在多种数据裁剪和通道组合下保持一致性,提升鲁棒性
  • 适合脑电信号噪声大、电极缺失场景的音乐重建任务

脑机接口旨在从神经信号中解码自然刺激,但现有研究主要集中在视觉与语言领域。本文探索更具挑战性却较少研究的脑电到音乐重建任务,该任务中信号微弱、分布广泛且极易受噪声和电极变异影响。核心发现是早期通道混合会破坏微弱但具有判别性的脑电信号。为此,提出通道导向设计,包含三个关键组件:通道级分词将每个电极视为显式标记以保留空间局部神经证据;通道级多视角自蒸馏通过时间裁剪和随机通道子集增强一致性,学习稳健的分布式表示;通道级数据增强引入结构化通道丢弃,提升对噪声、伪迹及缺失电极的不变性。三者协同保留跨通道的弱而有用信号,实现与语义音乐表示空间的稳定对齐。将该设计集成于编码-对齐-解码框架中。理论上,刻画了保留通道结构提升对齐效果的条件;实验上,对比多种先进基线,均表现出持续显著的性能提升。

原文摘要 · Abstract (English)

Brain-computer interfaces aim to decode naturalistic stimuli from neural signals, yet most progress to date has focused on vision and language. In this article, we study a more challenging but far less explored setting, EEG-to-music reconstruction, where signals are weak, distributed, and highly susceptible to noise and channel variability. Our central finding is that early channel mixing destroys weak but discriminative EEG signals. To address this, we propose a channel-oriented design with three key components. Specifically, channel-wise tokenization treats each electrode as an explicit token to retain spatially localized neural evidence, channel-wise multi-view self-distillation enforces consistency across temporal crops and random channel subsets to learn robust and distributed representations, and channel-wise data augmentation introduces structured channel dropout to improve invariance to noise, artifacts, and missing electrodes. Together, these components preserve weak yet informative signals across channels and enable stable alignment to a semantic music representation space. We integrate this channel-oriented design within an encoding-alignment-decoding pipeline for EEG-to-music reconstruction. Theoretically, we characterize when preserving channel-level structure leads to improved alignment. Empirically, we compare with a range of state-of-the-art baselines and demonstrate consistent and significant performance gains.

脑电生成音乐生成通道设计信号重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。