arXiv:2505.23784cs.SDcs.IR2025-05

用无监督方法自动识别音乐循环中的正常模式,避免人工标注。

Learning Normal Patterns in Musical Loops

  • 用预训练音频模型+特征融合提取音乐循环特征
  • 残差自编码器配合深度支持向量数据描述,准确区分异常段落
  • 适合处理多样音乐数据,无需人工干预,适用于音乐分析场景

本文提出一种无监督框架,通过异常检测技术识别音乐样本(循环)中的音频模式,解决音乐信息检索中的挑战。现有方法常受限于手工特征、领域特定性或依赖用户交互。本研究结合深度特征提取与无监督异常检测,采用预训练的分层标记-语义音频变压器(HTS-AT)和特征融合机制(FFM),生成可变长度音频循环的表示。这些嵌入通过单类深度支持向量数据描述(Deep SVDD)进行处理,学习将正常音频模式映射到紧凑的低维超球体。在精心构建的贝斯和吉他数据集上,对比标准与残差自编码器变体与隔离森林(IF)及主成分分析(PCA)等基线方法。结果表明,尤其残差自编码器版本的Deep SVDD模型在较大变化下表现出更优的异常分离能力。该研究提供了一种灵活、完全无监督的解决方案,克服了以往结构与输入限制,通过基于距离的潜在空间评分实现有效模式识别。

原文摘要 · Abstract (English)

This paper introduces an unsupervised framework for detecting audio patterns in musical samples (loops) through anomaly detection techniques, addressing challenges in music information retrieval (MIR). Existing methods are often constrained by reliance on handcrafted features, domain-specific limitations, or dependence on iterative user interaction. We address these limitations through an architecture combining deep feature extraction with unsupervised anomaly detection. Our approach leverages a pre-trained Hierarchical Token-semantic Audio Transformer (HTS-AT), paired with a Feature Fusion Mechanism (FFM), to generate representations from variable-length audio loops. These embeddings are processed using one-class Deep Support Vector Data Description (Deep SVDD), which learns normative audio patterns by mapping them to a compact latent hypersphere. Evaluations on curated bass and guitar datasets compare standard and residual autoencoder variants against baselines like Isolation Forest (IF) and and principle component analysis (PCA) methods. Results show our Deep SVDD models, especially the residual autoencoder variant, deliver improved anomaly separation, particularly for larger variations. This research contributes a flexible, fully unsupervised solution for processing diverse audio samples, overcoming previous structural and input limitations while enabling effective pattern identification through distance-based latent space scoring.

音频分析无监督学习音乐信息检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。