用生理信号和音频特征实时调节音效，让音乐表演更富情感
Go witheFlow: Real-time Emotion Driven Audio Effects Modulation
- 结合生理信号与音频特征自动调节音效
- 系统轻量可本地运行，支持实时音乐表演
- 适合音乐人、交互设计者与人机协作研究者
音乐表演是极具人性的活动，与表演者传达、唤起或表达情感的能力密不可分。机器虽能生成、再现或合成音乐，却缺乏情感体验能力。因此，音乐表演是探索人机协作的理想场景。本文提出witheFlow系统，通过从生理信号和音频本身提取特征，实现实时音频效果的自动调制，以增强音乐表演的情感表达。该系统目前处于概念验证阶段，具有轻量化设计，可在笔记本电脑上本地运行，并开放源代码。系统依赖兼容的数字音频工作站（DAW）和传感器，为实时音乐创作提供情感驱动的音效反馈。
原文摘要 · Abstract (English)
Music performance is a distinctly human activity, intrinsically linked to the performer's ability to convey, evoke, or express emotion. Machines cannot perform music in the human sense; they can produce, reproduce, execute, or synthesize music, but they lack the capacity for affective or emotional experience. As such, music performance is an ideal candidate through which to explore aspects of collaboration between humans and machines. In this paper, we introduce the witheFlow system, designed to enhance real-time music performance by automatically modulating audio effects based on features extracted from both biosignals and the audio itself. The system, currently in a proof-of-concept phase, is designed to be lightweight, able to run locally on a laptop, and is open-source given the availability of a compatible Digital Audio Workstation and sensors.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。