用NeRF思路生成不存在的脑电极数据,提升信号重建与分析能力
Neural Brain Fields: A NeRF-Inspired Approach for Generating Nonexistent EEG Electrodes
- 借鉴NeRF思想,将脑电极位置视为视角,学习连续神经活动表示
- 仅需单个样本即可生成固定长度特征向量,支持任意时间/空间点渲染
- 可模拟缺失电极数据,提升下游脑电分析模型性能,适合脑机接口研究
脑电图(EEG)数据因长度不一、信噪比低、个体差异大、会随时间漂移且缺乏大规模干净数据集,建模极具挑战。本文受神经辐射场(NeRF)启发,提出新方法:将不同头皮电极位置类比为计算机视觉中不同视角的图像,用于学习连续神经活动的隐式表示。通过单个EEG样本以NeRF风格训练神经网络,生成一个固定大小且信息丰富的权重向量,编码完整信号。基于该表示,可对任意未观测的时间步和电极位置进行信号渲染。实验表明,该方法能实现任意分辨率的脑活动连续可视化,包括超高分辨率,并恢复原始脑电信号。进一步实证显示,该方法可有效模拟缺失电极数据,使重构信号可用于标准脑电处理网络,从而提升性能。
原文摘要 · Abstract (English)
Electroencephalography (EEG) data present unique modeling challenges because recordings vary in length, exhibit very low signal to noise ratios, differ significantly across participants, drift over time within sessions, and are rarely available in large and clean datasets. Consequently, developing deep learning methods that can effectively process EEG signals remains an open and important research problem. To tackle this problem, this work presents a new method inspired by Neural Radiance Fields (NeRF). In computer vision, NeRF techniques train a neural network to memorize the appearance of a 3D scene and then uses its learned parameters to render and edit the scene from any viewpoint. We draw an analogy between the discrete images captured from different viewpoints used to learn a continuous 3D scene in NeRF, and EEG electrodes positioned at different locations on the scalp, which are used to infer the underlying representation of continuous neural activity. Building on this connection, we show that a neural network can be trained on a single EEG sample in a NeRF style manner to produce a fixed size and informative weight vector that encodes the entire signal. Moreover, via this representation we can render the EEG signal at previously unseen time steps and spatial electrode positions. We demonstrate that this approach enables continuous visualization of brain activity at any desired resolution, including ultra high resolution, and reconstruction of raw EEG signals. Finally, our empirical analysis shows that this method can effectively simulate nonexistent electrodes data in EEG recordings, allowing the reconstructed signal to be fed into standard EEG processing networks to improve performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。