arXiv:2607.26874cs.SD2026-07中稿 · ISMIR 2026

提出检测人机混合音乐中AI生成音轨的新方法

Detection of AI-generated stems within hybrid human-AI music

论文配图:Detection of AI-generated stems within hybrid human-AI music
图 1 · 摘自论文原文
  • 并行架构同时处理音轨能量与生成混音预测
  • 在MUSDB18-HQ上实现72.3%的音轨级检测准确率
  • 适合音乐版权鉴定与AI内容溯源场景

本文首次研究通过混合人类创作与AI生成音轨构建的人机混合音乐作品的检测问题。基于现有研究表明AI音乐检测器可识别完全生成音乐中的解码器相关痕迹,我们探究这些痕迹在音轨级别混合后是否仍可被探测。利用MUSDB18-HQ数据库,在两音轨(人声+伴奏)设置下,通过神经编解码器自动编码单个音轨生成混合样本。比较了两种结合AI生成混音检测与源分离的策略:朴素串行流程(先分离后检测)表明通用源分离系统无法可靠恢复AI生成音轨的痕迹;因此提出并行架构,仅用源分离估计音轨相对能量,再训练针对各音轨的二分类器,输入为生成混音预测结果及目标音轨的短音频片段相对能量。对片段级预测进行平均,获得令人鼓舞的曲目级结果,凸显该方法在检测混合音乐中AI生成音轨方面的潜力。

原文摘要 · Abstract (English)

This paper presents, to the best of our knowledge, the first study on detecting human-AI hybrid music tracks created by mixing human-produced and AI-generated stems. Building on recent work showing that AI music detectors can identify decoder-related artifacts in fully generated music, we investigate whether such artifacts remain detectable at the stem level after mixing. Using MUSDB18-HQ database in a two-stem vocals + accompaniment setting, we simulate hybrid mixtures by autoencoding individual stems with a neural codec. We compare two strategies combining AI-generated mix detection and source separation. A naive sequential pipeline, where source separation is followed by detection on separated sources, confirms that artifacts associated with an AI-generated stem are not reliably recovered by generic source separation systems. We therefore propose a parallel architecture in which source separation is only used to estimate source-relative energy within the mixture. We then train simple stem-specific binary classifiers that take as input the generated mix prediction together with the relative energy of the target stem on short audio chunks. Averaging chunk-level predictions yields encouraging track-level results, highlighting the potential of such approaches for detecting AI-generated stems in hybrid music.

AI音乐音轨检测混合内容源分离

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。