arXiv:2608.14916cs.SDcs.AI2026-08中稿 · IJCAI

测试AI生成音乐在编辑后是否仍可被识别,发现其谱特征仍可被捕捉但易与编辑噪声混淆。

Distinguishing AI-Generated Music from Edited Audio as a Hard-Negative Robustness Task

  • 用同一首歌的AI生成版和编辑版构建硬负样本,评估检测器鲁棒性
  • 视频级准确率达0.811,生成片段F1为0.836,编辑片段F1为0.720
  • 揭示生成音频具独特频谱指纹,但编辑噪声会干扰检测,适合安全与内容审核场景

AI生成音乐检测器通常在原始歌曲上评估,但真实上传内容常经过混音、重编码、变调等编辑。这些编辑版本构成困难的负类:非AI生成,却可能引入类似合成音频的频谱伪影。本文将此问题视为硬负样本鲁棒性任务,聚焦同一锚点歌曲生成的AI版本与编辑版本。基于YouTube构建数据集,仅使用原曲作为参考,训练二分类检测器。音频以10秒片段处理,输入预训练PaSST光谱变压器,所有划分按锚点歌曲进行以减少泄漏。在保留测试集上,最终视频级系统达到0.811平衡准确率;片段级中,AI生成片段F1为0.836,编辑片段为0.720。结果表明,AI生成音乐保留可检测的谱特征,但编辑引入的伪影仍与之部分重叠。通过Grad-CAM可视化分析,发现高置信度预测依赖特定时频区域。

原文摘要 · Abstract (English)

AI-generated music detectors are commonly evaluated against original songs, but real-world uploads are often remixed, re-encoded, pitch-shifted, or otherwise edited. These edited versions form a difficult negative class: they are not generated by AI, yet they may introduce spectral artifacts that resemble synthetic audio fingerprints. We study this problem as a hard-negative robustness setting for AI-generated music detection, focusing on AI-generated and edited variants derived from the same anchor songs. We compile a YouTube-based dataset of AI, edited, and original variants, using the original tracks only as references, and train a binary AI versus edited detector. Audio is processed as 10-second clips and passed as raw waveforms to a pretrained PaSST spectrogram transformer. To reduce leakage, all splits are performed by anchor song. On the held-out test set, the final video-level system achieves 0.811 balanced accuracy. At clip level, AI-generated clips reach an F1-score of 0.836, while edited clips reach a lower F1-score of 0.720. The results suggest that AI-generated music retains detectable fingerprint-like spectral cues beyond ordinary editing, but the lower edited-class F1-score shows that these cues can still overlap with artifacts from edited audio. Grad-CAM visualizations are used to inspect whether high-confidence predictions rely on localized time-frequency regions.

AI音乐检测硬负样本频谱分析音频安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。