arXiv:2606.13640cs.SD2026-06

用生成式AI让虚拟吟诵声动态参与印度音乐即兴,形成人机共创的互动关系。

The Moving Drone: Negotiating Agency Between the Voice and the Virtual

论文配图:The Moving Drone: Negotiating Agency Between the Voice and the Virtual
图 1 · 摘自论文原文
  • 通过Max/MSP实时控制四个虚拟吟诵循环,随歌手即兴动态生成。
  • 采用低保真生成音频,强调人类解释与情境理解的重要性。
  • 将生成AI融入传统音乐实践,展现技术作为合作创作伙伴的潜力。

印度古典音乐中的旋律以持续的主音(tanpura)为基础。本文《The Moving Drone》将传统静态吟诵声转化为动态变化的虚拟吟诵,随着表演进程逐步增强其主动性,从被动响应转向主动参与。作品利用Max/MSP中的四个独立采样循环器实现‘虚拟’吟诵,实时随歌手即兴填充并构建语音与虚拟吟诵间的有机反馈回路。通过音高偏移引入突现的、明确的运动感;再结合受歌手训练的音高转语音生成模型GaMaDHaNi,实现音色层面的演变。不同于当前音乐AI普遍追求高保真与逼真度所引发的职业焦虑,本研究有意使用低保真生成输出,强调人类解读与情境语境在完成艺术表达中的关键作用。该作品将生成式AI置于既有社会文化音乐实践中,提出虚拟吟诵可作为具有主动性、响应性与共创性的音乐代理角色。

原文摘要 · Abstract (English)

Melodic material in Hindustani music is presented in relation to a tonic, usually sustained by the tanpura, a four-stringed drone instrument. Rooted in Hindustani music, 'The Moving Drone' sets the traditionally static drone into motion that, throughout the performance, gains increasing agency transitioning from reactive to more proactive roles. The work employs four independent loopers in Max/MSP to function as 'virtual' drones. They are populated cyclically in real-time as the vocalist improvises, creating an organic and evolving feedback loop between the voice and the virtual drone. This relationship further evolves melodically by pitch shifting the loops, which introduces a dimension of sudden, explicit movement. Then it changes timbrally, via the integration of GaMaDHaNi, a singer conditioned pitch-to-voice generative AI model to resynthesize looped audio. While current music AI approaches prioritize high-fidelity and realism of generated content which has sparked anxiety over job replacement for the music community, this work intentionally utilizes low-fidelity generative outputs, further necessitating human interpretation and situational context in order to be complete. 'The Moving Drone' positions technology and generative AI within established socio-cultural musical practices, proposing a virtual drone as an active, responsive, and co-creative musical agent.

生成音乐人机交互声音艺术印度音乐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。