机器人摄像机通过视觉信号与音乐家实时互动，实现共同创作。
Creativity and Visual Communication from Machine to Musician: Sharing a Score through a Robotic Camera
- 用可变焦摄像机捕捉音乐家动作，实时生成视觉反馈。
- 实验验证了非语言视觉信号能有效促进人机协同创编。
- 适合对人机协作、音乐交互设计感兴趣的读者。
本文通过在“引导和声”音乐游戏中引入机器人摄像机，探索视觉通信与音乐互动的融合。研究旨在考察人类音乐家与机器人系统之间的共创行为。现有即兴游戏方法被扩展至包含机器人参与，利用PTZ摄像机作为视觉交互媒介。该系统能解析并响应音乐家的非语言信号，构建出协作式、自适应的音乐体验。初步案例研究强调了直观视觉沟通渠道的重要性。未来研究方向包括优化视觉提示工具包参数及数据收集方法，以更深入理解人机共创机制。研究结果有助于深化机器智能在增强人类创造力，尤其是在音乐场景中的应用认知。
原文摘要 · Abstract (English)
This paper explores the integration of visual communication and musical interaction by implementing a robotic camera within a "Guided Harmony" musical game. We aim to examine co-creative behaviors between human musicians and robotic systems. Our research explores existing methodologies like improvisational game pieces and extends these concepts to include robotic participation using a PTZ camera. The robotic system interprets and responds to nonverbal cues from musicians, creating a collaborative and adaptive musical experience. This initial case study underscores the importance of intuitive visual communication channels. We also propose future research directions, including parameters for refining the visual cue toolkit and data collection methods to understand human-machine co-creativity further. Our findings contribute to the broader understanding of machine intelligence in augmenting human creativity, particularly in musical settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。