arXiv:2506.14684cs.SDcs.AI2025-06中稿 · International Conf…被引 2

用图神经网络提升音乐采样识别准确率,对变调变速等处理更鲁棒。

Refining music sample identification with a self-supervised graph neural network

  • 基于对比学习的图神经网络编码器,参数量仅为现有最优模型的9%。
  • 在真实场景下达到44.2%的平均精度,对短音频查询有专门优化。
  • 两阶段检索设计,可精准筛选候选并优化排序,适合实际应用。

自动采样识别(ASID)是检测音频片段在新作品中被重用的关键任务,但面临音乐制作中常见变换(如变调、变速、混响、叠加伴奏)的挑战。本文提出一种轻量级图神经网络架构,结合对比学习,在仅使用当前最优系统9%可训练参数的前提下,达到44.2%的平均精度(mAP)。为提升检索质量,引入两阶段方法:先粗筛候选,再通过交叉注意力分类器剔除无关匹配并优化排序。针对真实应用中查询片段较短的问题,本文还发布了Sample100数据集的细粒度标注,并在此基础上进行短查询性能评估。

原文摘要 · Abstract (English)

Automatic sample identification (ASID), the detection and identification of portions of audio recordings that have been reused in new musical works, is an essential but challenging task in the field of audio query-based retrieval. While a related task, audio fingerprinting, has made significant progress in accurately retrieving musical content under "real world" (noisy, reverberant) conditions, ASID systems struggle to identify samples that have undergone musical modifications. Thus, a system robust to common music production transformations such as time-stretching, pitch-shifting, effects processing, and underlying or overlaying music is an important open challenge. In this work, we propose a lightweight and scalable encoding architecture employing a Graph Neural Network within a contrastive learning framework. Our model uses only 9% of the trainable parameters compared to the current state-of-the-art system while achieving comparable performance, reaching a mean average precision (mAP) of 44.2%. To enhance retrieval quality, we introduce a two-stage approach consisting of an initial coarse similarity search for candidate selection, followed by a cross-attention classifier that rejects irrelevant matches and refines the ranking of retrieved candidates - an essential capability absent in prior models. In addition, because queries in real-world applications are often short in duration, we benchmark our system for short queries using new fine-grained annotations for the Sample100 dataset, which we publish as part of this work.

音乐识别图神经网络对比学习音频检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。