用可变形触觉界面让小白也能直观创作音乐。
DeformTune: A Deformable XAI Music Prototype for Non-Musicians
- 通过可变形硬件+MeasureVAE模型实现身体化交互。
- 11位无乐理背景用户反馈控制不清晰、表达受限。
- 适合想简化AI音乐工具的设计师和初学者。
现有AI音乐生成工具多依赖文本提示、复杂界面或乐器式操控，对非音乐人不够友好。本文提出DeformTune原型系统，结合触觉可变形界面与MeasureVAE模型，探索更直观、具身体验且可解释的AI交互方式。我们对11名无正式音乐训练的成年参与者进行了初步研究，分析其使用反馈后发现主要挑战包括控制映射不清、表达范围有限以及全程需引导。文章讨论了提升AI可解释性的设计机会，如多模态反馈与渐进式交互支持。这些发现为面向新手用户的AI音乐系统提供早期实践启示。
原文摘要 · Abstract (English)
Many existing AI music generation tools rely on text prompts, complex interfaces, or instrument-like controls, which may require musical or technical knowledge that non-musicians do not possess. This paper introduces DeformTune, a prototype system that combines a tactile deformable interface with the MeasureVAE model to explore more intuitive, embodied, and explainable AI interaction. We conducted a preliminary study with 11 adult participants without formal musical training to investigate their experience with AI-assisted music creation. Thematic analysis of their feedback revealed recurring challenge--including unclear control mappings, limited expressive range, and the need for guidance throughout use. We discuss several design opportunities for enhancing explainability of AI, including multimodal feedback and progressive interaction support. These findings contribute early insights toward making AI music systems more explainable and empowering for novice users.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。