用可穿戴设备融合脑电与血流信号,评估AI生成音乐引发的情绪。
Wearable Music2Emotion : Assessing Emotions Induced by AI-Generated Music through Portable EEG-fNIRS Fusion
- 用AI自动生成多样音乐,避免人为选曲偏差。
- 通过轻便头戴式设备同步采集脑电与近红外信号。
- 数据集覆盖44人,支持情绪分析研究与应用。
情绪对心理健康至关重要,推动了基于神经生理信号的音乐情感计算研究。现有研究受限于小规模音乐库、单模态信号依赖及设备不便携带等问题。为此,我们提出MEEtBrain框架,利用便携式无线头戴设备,结合AI生成的音乐刺激与同步的脑电(EEG)和功能性近红外光谱(fNIRS)信号采集。该系统可大规模生成多样化音乐,消除主观选曲偏差,并通过轻量化干电极头带实现多模态数据实时获取。首次招募20名参与者完成14小时数据采集,验证了目标情绪(效价/唤醒度)的有效诱导。当前数据集已扩展至44名参与者,公开发布以促进后续研究与实际应用。数据集地址:https://zju-bmi-lab.github.io/ZBra。
原文摘要 · Abstract (English)
Emotions critically influence mental health, driving interest in music-based affective computing via neurophysiological signals with Brain-computer Interface techniques. While prior studies leverage music's accessibility for emotion induction, three key limitations persist: \textbf{(1) Stimulus Constraints}: Music stimuli are confined to small corpora due to copyright and curation costs, with selection biases from heuristic emotion-music mappings that ignore individual affective profiles. \textbf{(2) Modality Specificity}: Overreliance on unimodal neural data (e.g., EEG) ignores complementary insights from cross-modal signal fusion.\textbf{ (3) Portability Limitation}: Cumbersome setups (e.g., 64+ channel gel-based EEG caps) hinder real-world applicability due to procedural complexity and portability barriers. To address these limitations, we propose MEEtBrain, a portable and multimodal framework for emotion analysis (valence/arousal), integrating AI-generated music stimuli with synchronized EEG-fNIRS acquisition via a wireless headband. By MEEtBrain, the music stimuli can be automatically generated by AI on a large scale, eliminating subjective selection biases while ensuring music diversity. We use our developed portable device that is designed in a lightweight headband-style and uses dry electrodes, to simultaneously collect EEG and fNIRS recordings. A 14-hour dataset from 20 participants was collected in the first recruitment to validate the framework's efficacy, with AI-generated music eliciting target emotions (valence/arousal). We are actively expanding our multimodal dataset (44 participants in the latest dataset) and make it publicly available to promote further research and practical applications. \textbf{The dataset is available at https://zju-bmi-lab.github.io/ZBra.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。