arXiv:2410.03375cs.SDcs.AI2024-10被引 6

用AI分析音乐偏好,生成个性化听觉性格报告。

SoundSignature: What Type of Music Do You Like?

  • 结合音频特征与大模型知识,解析用户喜爱歌曲的声学属性。
  • 支持交互式追问,可获取和弦、分轨等专业音频处理结果。
  • 适合音乐爱好者和零代码用户,兼具教育意义与实用功能。

SoundSignature 是一款集成定制 OpenAI 助手的音乐应用,通过先进的音乐信息检索(MIR)Python 工具包提取歌曲的声学/音乐特征,并融合助手对艺术家与乐队的广泛知识。利用语义音频与新兴声音互联网(IoS)理念,该系统将 MIR 与 AI 结合,为用户提供类似“音乐偏好人格报告”的个性化洞察。用户可通过聊天机器人深入探究分析结果及其与音乐品味的关系。应用还整合了多个开源音乐工具:和弦识别(CREMA)、音源分离(DEMUCS)及音频转 MIDI(basic-pitch),使无编程背景的用户仅通过对话即可调用复杂算法(如“请给出这首歌的分轨”)。本文介绍其创新功能与教育潜力,并呈现一项小规模用户研究的结果,验证其有效性与易用性。

原文摘要 · Abstract (English)

SoundSignature is a music application that integrates a custom OpenAI Assistant to analyze users' favorite songs. The system incorporates state-of-the-art Music Information Retrieval (MIR) Python packages to combine extracted acoustic/musical features with the assistant's extensive knowledge of the artists and bands. Capitalizing on this combined knowledge, SoundSignature leverages semantic audio and principles from the emerging Internet of Sounds (IoS) ecosystem, integrating MIR with AI to provide users with personalized insights into the acoustic properties of their music, akin to a musical preference personality report. Users can then interact with the chatbot to explore deeper inquiries about the acoustic analyses performed and how they relate to their musical taste. This interactivity transforms the application, acting not only as an informative resource about familiar and/or favorite songs, but also as an educational platform that enables users to deepen their understanding of musical features, music theory, acoustic properties commonly used in signal processing, and the artists behind the music. Beyond general usability, the application also incorporates several well-established open-source musician-specific tools, such as a chord recognition algorithm (CREMA), a source separation algorithm (DEMUCS), and an audio-to-MIDI converter (basic-pitch). These features allow users without coding skills to access advanced, open-source music processing algorithms simply by interacting with the chatbot (e.g., can you give me the stems of this song?). In this paper, we highlight the application's innovative features and educational potential, and present findings from a pilot user study that evaluates its efficacy and usability.

音乐分析AI助手MIR教育应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。