让语音合成水印在压缩后仍有效,对抗音频编码攻击。
Audio Codec Augmentation for Robust Collaborative Watermarking of Speech Synthesis
- 用波形域直通估计器实现黑盒编码器下的水印增强。
- 高码率编码下水印可保留且听感几乎无损。
- 神经与传统编码器间水印迁移效果好,适合防伪造场景。
自动检测合成语音的重要性日益凸显,因当前合成技术已接近人类语音水平且公众广泛可得。音频水印等主动披露方法正受关注,可补充基于被动检测的传统深度伪造防御。在主动与被动检测中,鲁棒性是关键。传统音频水印易受音频编码器处理的影响,而绝大多数生成语音在公开传播时都会经过音频编码。我们此前提出协作水印法,使生成语音在存在噪声但可微的传输信道中更易被检测。本文将该信道增强扩展至不可微的传统音频编码器与神经音频编码器,并评估了不同配置下码率对水印鲁棒性及迁移性的影响。结果表明,通过波形域直通估计器可可靠地在黑盒编码器中实现协作水印增强;同时,神经编码器中的增强可良好迁移至传统编码器。听感测试显示,高码率编码或8kbps DAC下,协作水印感知损失极小。
原文摘要 · Abstract (English)
Automatic detection of synthetic speech is becoming increasingly important as current synthesis methods are both near indistinguishable from human speech and widely accessible to the public. Audio watermarking and other active disclosure methods of are attracting research activity, as they can complement traditional deepfake defenses based on passive detection. In both active and passive detection, robustness is of major interest. Traditional audio watermarks are particularly susceptible to removal attacks by audio codec application. Most generated speech and audio content released into the wild passes through an audio codec purely as a distribution method. We recently proposed collaborative watermarking as method for making generated speech more easily detectable over a noisy but differentiable transmission channel. This paper extends the channel augmentation to work with non-differentiable traditional audio codecs and neural audio codecs and evaluates transferability and effect of codec bitrate over various configurations. The results show that collaborative watermarking can be reliably augmented by black-box audio codecs using a waveform-domain straight-through-estimator for gradient approximation. Furthermore, that results show that channel augmentation with a neural audio codec transfers well to traditional codecs. Listening tests demonstrate collaborative watermarking incurs negligible perceptual degradation with high bitrate codecs or DAC at 8kbps.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。