首次实现生成音频的模型与数据源双重溯源,解决版权追踪难题。
DualMark: Identifying Model and Training Data Origins in Generated Audio
- 通过双水印嵌入模块,在梅尔频谱中同时编码模型和数据源信息。
- 模型溯源准确率97.01% F1,数据源溯源AUC达91.51%,抗剪枝等攻击能力强。
- 适用于需版权保护和责任追溯的音频生成场景,如音乐、语音合成。
现有音频生成模型水印方法仅支持模型级溯源,无法追踪训练数据来源,导致在版权与责任认定上存在重大缺陷。为此,我们提出DualMark,首个支持模型与数据源双重溯源的水印框架,可在训练阶段同时向生成模型嵌入两种独立的归属签名。具体而言,设计了新型双水印嵌入(DWE)模块,将双水印无缝嵌入梅尔频谱表示,并引入水印一致性损失(WCL),确保生成音频中可稳定提取两类水印。此外,构建首个面向联合溯源的鲁棒性评估基准——双溯源基准(DAB)。大量实验表明,DualMark在模型溯源上达到97.01% F1-score,数据源溯源达91.51% AUC,且对剪枝、有损压缩、加性噪声及采样攻击具有极强鲁棒性,显著优于以往方法。本工作为实现完全可问责的音频生成模型奠定基础,大幅提升版权保护与责任追溯能力。
原文摘要 · Abstract (English)
Existing watermarking methods for audio generative models only enable model-level attribution, allowing the identification of the originating generation model, but are unable to trace the underlying training dataset. This significant limitation raises critical provenance questions, particularly in scenarios involving copyright and accountability concerns. To bridge this fundamental gap, we introduce DualMark, the first dual-provenance watermarking framework capable of simultaneously encoding two distinct attribution signatures, i.e., model identity and dataset origin, into audio generative models during training. Specifically, we propose a novel Dual Watermark Embedding (DWE) module to seamlessly embed dual watermarks into Mel-spectrogram representations, accompanied by a carefully designed Watermark Consistency Loss (WCL), which ensures reliable extraction of both watermarks from generated audio signals. Moreover, we establish the Dual Attribution Benchmark (DAB), the first robustness evaluation benchmark specifically tailored for joint model-data attribution. Extensive experiments validate that DualMark achieves outstanding attribution accuracy (97.01% F1-score for model attribution, and 91.51% AUC for dataset attribution), while maintaining exceptional robustness against aggressive pruning, lossy compression, additive noise, and sampling attacks, conditions that severely compromise prior methods. Our work thus provides a foundational step toward fully accountable audio generative models, significantly enhancing copyright protection and responsibility tracing capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。