arXiv:2605.29202cs.LG2026-05中稿 · presentation at th…

通过黑盒查询检测音乐生成模型是否训练过某段音频。

Auditing Training Data in Generative Music Models via Black-Box Membership Inference

论文配图:Auditing Training Data in Generative Music Models via Black-Box Membership Inference
图 1 · 摘自论文原文
  • 用提示词触发生成,比对候选音频与生成结果的特征对齐度。
  • 在多个顶级音乐生成模型上达到98.6%准确率,误报率低至1.9%。
  • 无需模型参数即可审计,适合关注数据合规的创作者和平台。

文本到音乐生成技术的进步实现了高质量结构化音频合成,引发对数据来源、授权及训练透明性的关注。这些模型通常在大规模语料上训练且披露有限,缺乏验证特定音频是否被用于训练的实际机制。本文研究生成音乐模型的黑盒成员推断问题,仅通过查询部署系统判断候选音频样本是否曾被用于训练。核心思路是:训练成员会引发候选样本与模型基于标题生成结果之间更强的语义与结构对齐。我们通过关联标题查询目标模型,并在学习特征空间中测量候选音频与生成输出的关系。为捕捉成员与非成员的差异特征,构建由每首曲目及其阴影模型生成结果组成的配对样本,训练音乐审计器进行分类。该审计器学习了训练成员特有的对齐模式,可在无模型参数或训练元数据的情况下,泛化至未见过的目标模型。在多个先进音乐生成器上,方法最高达98.6%准确率,假阳性与假阴性率分别低至1.9%和1.0%,证明在真实部署场景中可靠训练数据审计是可行的。

原文摘要 · Abstract (English)

Recent advances in text-to-music generation enable high-fidelity synthesis of structured musical audio, raising growing concerns about data provenance, consent, and training transparency. These models are typically trained on large-scale corpora with little disclosure, leaving no practical mechanism to verify whether a particular audio sample was included in training. In this paper, we investigate black-box membership inference for generative music models, aiming to determine whether a candidate music sample was used during training, given only query access to the deployed system. Our key insight is that training membership induces systematically stronger semantic and structural alignment between a candidate sample and the model's generation conditioned on its caption. We query the target model with the associated caption and measure the relationship between the candidate audio and the generated output in a learned feature space. To capture features that separate members from non-members, we construct paired examples consisting of each track and its caption-conditioned generation from shadow models, and train a music auditor to classify membership. The auditor captures alignment patterns characteristic of training membership and generalizes to unseen target models in a fully black-box setting without access to model parameters or training metadata. Across multiple state-of-the-art music generators, our method achieves up to 98.6% accuracy, with false-positive and false-negative rates as low as 1.9% and 1.0%, demonstrating that reliable training-data auditing is feasible in realistic deployment scenarios.

音乐生成数据审计黑盒检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。