用脑电波实时生成个性化音乐,动态调节情绪状态。
MindMelody: A Closed-Loop EEG-Driven System for Personalized Music Intervention

- 通过脑电解码情绪状态,用大模型制定干预方案。
- 实现脑电驱动的音乐生成,反馈环提升情绪匹配度。
- 适合心理健康干预、人机交互研究者使用。
针对全球精神健康问题日益严峻,基于音乐的非侵入性干预因其成本低、易操作备受关注,但现有数字音乐服务依赖静态偏好,无法响应用户即时心理状态。此外,直接将脑电图(EEG)映射至音乐生成面临配对数据稀缺与可解释性差的挑战。为此,我们提出完整闭环的实时脑电驱动个性化音乐干预系统MindMelody。该系统引入情绪介导的语义桥梁:首先利用混合Transformer-GNN模型从实时脑电信号中解码出全局效价-唤醒度状态与局部时间情感轨迹;随后将这些状态输入配备检索增强生成(RAG)的大语言模型(LLM),生成结构化干预计划;再通过新型分层脑电控制器,将全局情感前缀与局部时间引导注入预训练音乐骨干模型,实现细粒度可控音频合成。系统还嵌入连续反馈环,根据用户脑电动态实时更新生成参数。大量实验表明,MindMelody显著提升控制一致性与情绪对齐度,在短期聆听测试中获得更高感知帮助性,验证其作为自适应情绪感知音乐生成框架的潜力。
原文摘要 · Abstract (English)
Driven by the escalating global burden of mental health conditions, music-based interventions have attracted significant attention as a non-invasive, cost-effective modality for emotion regulation and psychological stress relief. However, current digital music services rely on static preferences and fail to adapt to users' instantaneous psychological states. Furthermore, directly mapping electroencephalography (EEG) to music generation remains challenging due to severe paired-data scarcity and a lack of interpretability. To address these limitations, we propose MindMelody, a fully functional, closed-loop real-time system for EEG-driven personalized music intervention. MindMelody introduces an emotion-mediated semantic bridge. Specifically, a hybrid Transformer-GNN first decodes real-time EEG signals into global Valence-Arousal states and local temporal affect trajectories. These states are then fed into a Retrieval-Augmented Generation (RAG)-equipped Large Language Model (LLM) to formulate structured intervention plans. Subsequently, a novel Hierarchical EEG Controller injects global affect prefixes and local temporal guidance into a pretrained music backbone, enabling fine-grained controllable audio synthesis. Crucially, the system incorporates a continuous feedback loop that updates generation parameters on the fly based on the user's evolving EEG dynamics. Extensive experiments show that MindMelody improves control adherence and emotional alignment, and receives higher perceived helpfulness in a short-term listening setting, suggesting its promise as an adaptive affect-aware music generation framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。