arXiv:2604.25207cs.SD2026-04中稿 · publication at the…

AI乐器通过双向反馈与人共同即兴创作,打破传统工具关系。

Huí Sù: Co-constructing a Dual Feedback Apparatus

论文配图:Huí Sù: Co-constructing a Dual Feedback Apparatus
图 1 · 摘自论文原文
  • Sù在声学空间用潜变量反馈,记忆自身声音状态。
  • Agentier在控制空间用递归网络反馈,动态演化操作信号。
  • 人机协同生成音乐,强调互动中的共谋与抵抗。

本演出呈现了两件智能乐器Sù(意为回溯、逆流而上)与Agentier(基于代理式键盘演奏)及其人类表演者之间的二重奏,通过反馈回路实现连接。与将AI视为对输入做出可预测响应的工具不同,两个系统均以递归方式运行,过去行为持续影响未来表现。Sù在音频空间中通过潜在表示运作,其表演者使用Make Noise 0系列合成器和MIDI控制器,与基于RAVE模型的神经反馈合成系统协作,模型内部嵌入潜变量反馈回路,使仪器能记忆并复用自身内部状态,通过近期声学历史影响当前声音生成。Agentier则在控制空间运作,其表演者使用Roland S-1合成器和Keith McMillen QuNeo触控板,将控制手势输入递归神经网络,反馈至合成过程。该反馈回路使系统主动塑造控制信号的时序演化。通过对比音频与控制域的反馈机制,演出探讨了人与智能音乐系统间的共享主体性、对抗与协商。音乐现象由交互状态的纠缠共同生成,而非预设系统配置或固定映射。

原文摘要 · Abstract (English)

This performance presents a duet between two intelligent musical instruments, Sù (to trace back; to go upstream) and Agentier (playing on agentic clavier), and their human performers, connected through feedback loops. Rather than treating AI as a tool that responds predictably to input, both systems operate recursively, where past actions continuously influence future behaviour. The Sù operates in the audio space through latent representation. Its performer uses Make Noise 0-series synthesisers and MIDI controllers to work with a neural feedback synthesis system based on a RAVE model, with a latent feedback loop embedded within the model's internal structure. This allows the instrument to remember and reuse its own internal states, influencing ongoing sound generation through its recent sonic history. The Agentier functions in the control space. Its performer interacts with the system using a Roland S-1 synthesiser and Keith McMillen QuNeo touchpad, where control gestures are routed into a recurrent neural network that feeds back into the synthesis process. Through this feedback loop, the system actively shapes the evolution of control signals over time. Contrasting feedback in the audio and control domains, the performance explores shared agency, resistance, and negotiation between humans and intelligent musical systems. Musical phenomena are co-produced through the entangled states of interaction, rather than through pre-existing system configuration or fixed mappings.

音乐生成反馈系统人机协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。