系统评估机器生成音乐检测方法,揭示最佳模型并解析其决策逻辑。
Explainable Detection of Machine Generated Music and Early Systematic Evaluation
- 对比多种音频模型在机器生成音乐检测中的表现。
- ResNet18在域内与域外测试中表现最优。
- 使用可解释AI工具分析模型决策过程,提升透明性。
机器生成音乐(MGM)在音乐治疗、个性化编辑和创意启发等领域展现出广泛应用前景。然而,其无序扩散对娱乐、教育和艺术领域构成挑战,可能削弱高质量人类创作的价值。因此,机器生成音乐检测(MGMD)对维护这些领域的完整性至关重要。尽管意义重大,当前MGMD领域缺乏全面的系统性评估。为此,我们基于现有大规模数据集,采用多种基础音频处理模型开展实验,涵盖传统机器学习、深度神经网络、Transformer架构及状态空间模型(SSM),并探索融合旋律与歌词的多模态模型。除二分类结果外,还利用多种可解释人工智能(XAI)工具深入分析模型行为,揭示其决策机制。结果表明,ResNet18在域内与域外测试中表现最佳。通过提供系统性评估与可解释性对比,本文提出若干研究方向,以推动更鲁棒、高效的MGM检测方法发展。代码与样本已开源。
原文摘要 · Abstract (English)
Machine-generated music (MGM) has become a groundbreaking innovation with wide-ranging applications, such as music therapy, personalised editing, and creative inspiration within the music industry. However, the unregulated proliferation of MGM presents considerable challenges to the entertainment, education, and arts sectors by potentially undermining the value of high-quality human compositions. Consequently, MGM detection (MGMD) is crucial for preserving the integrity of these fields. Despite its significance, MGMD domain lacks comprehensive systematic evaluation results necessary to drive meaningful progress. To address this gap, we conduct experiments on existing large-scale datasets using a range of foundational models for audio processing, establishing systematic evaluation results tailored to the MGMD task. Our selection includes traditional machine learning models, deep neural networks, Transformer-based architectures, and State space models (SSM). Recognising the inherently multimodal nature of music, which integrates both melody and lyrics, we also explore fundamental multimodal models in our experiments. Beyond providing basic binary classification outcomes, we delve deeper into model behaviour using multiple explainable Artificial Intelligence (XAI) tools, offering insights into their decision-making processes. Our analysis reveals that ResNet18 performs the best according to in-domain and out-of-domain tests. By providing a comprehensive comparison of systematic evaluation results and their interpretability, we propose several directions to inspire future research to develop more robust and effective detection methods for MGM. We provide our codes and some samples on Github repository.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。