arXiv:2409.12549cs.SDeess.AS2024-09中稿 · the 25th Internati…被引 3

构建日本偶像团体歌曲真实数据集,标注每位歌手的演唱片段。

FruitsMusic: A Real-World Corpus of Japanese Idol-Group Songs

  • 基于40个偶像团体音乐视频,标注每段歌声的演唱者与时间。
  • 涵盖4至9人团体,覆盖多种曲风与分段演唱模式。
  • 可用于提升歌手识别与音乐信息检索技术,适合跨文化研究者。

本研究提出FruitsMusic,一个真实世界中日本偶像团体歌曲的元数据语料库,精确标注了每位歌手在何时演唱。日本偶像团体歌曲是日本流行文化的重要组成部分,其独特的声乐编排风格将歌曲划分为多个段落,每个段落由特定个人或多人演唱。为提升识别此类结构的歌手分割方法,我们利用40个来自YouTube的日本偶像团体音乐视频构建了FruitsMusic语料库。该语料库包含详细标注,涵盖多种音乐类型、分段与分配方式,以及成员数为4至9人的团体。FruitsMusic还推动了歌词转录、歌手识别等音乐信息检索技术的发展,不仅适用于日本偶像歌曲,也适用于全球多种文化背景下的单人或多人演唱歌曲。本文全面介绍了FruitsMusic的构建方法及其与对话语音的差异。此外,本文评估了当前歌手嵌入提取与分割方法在真实场景下的表现,并通过对比人工性能探讨了自动分割性能的改进潜力。

原文摘要 · Abstract (English)

This study presents FruitsMusic, a metadata corpus of Japanese idol-group songs in the real world, precisely annotated with who sings what and when. Japanese idol-group songs, vital to Japanese pop culture, feature a unique vocal arrangement style, where songs are divided into several segments, and a specific individual or multiple singers are assigned to each segment. To enhance singer diarization methods for recognizing such structures, we constructed FruitsMusic as a resource using 40 music videos of Japanese idol groups from YouTube. The corpus includes detailed annotations, covering songs across various genres, division and assignment styles, and groups ranging from 4 to 9 members. FruitsMusic also facilitates the development of various music information retrieval techniques, such as lyrics transcription and singer identification, benefiting not only Japanese idol-group songs but also a wide range of songs featuring single or multiple singers from various cultures. This paper offers a comprehensive overview of FruitsMusic, including its creation methodology and unique characteristics compared to conversational speech. Additionally, this paper evaluates the efficacy of current methods for singer embedding extraction and diarization in challenging real-world conditions using FruitsMusic. Furthermore, this paper examines potential improvements in automatic diarization performance through evaluating human performance.

音乐数据集歌手分割日本偶像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。