用脑控立方体生成音乐,帮人调节情绪
Two Sonification Methods for the MindCube
- 无AI时直接映射传感器数据到音高节奏
- 有AI时在潜在空间中生成有意义音乐
- 适合心理调节与交互设计研究者
本文探索了MindCube这一交互设备在音乐接口方面的潜力。该设备集成了多种传感器和输入装置,外形类似缓解压力的减压玩具,非常适合作为情绪调节类音乐系统的控制器。文中提出了两种不同的映射方式:一种不依赖人工智能,直接将传感器数据映射为音乐参数;另一种基于生成式AI,通过外部控制器在潜在空间中导航并生成具有语义意义的音乐内容。我们分析了实验结果,并提出了未来研究方向。
原文摘要 · Abstract (English)
In this work, we explore the musical interface potential of the MindCube, an interactive device designed to study emotions. Embedding diverse sensors and input devices, this interface resembles a fidget cube toy commonly used to help users relieve their stress and anxiety. As such, it is a particularly well-suited controller for musical systems that aim to help with emotion regulation. In this regard, we present two different mappings for the MindCube, with and without AI. With our generative AI mapping, we propose a way to infuse meaning within a latent space and techniques to navigate through it with an external controller. We discuss our results and propose directions for future work.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。