arXiv:2603.20165cs.SDeess.AS2026-03

用声纹指纹技术验证合成语音是否授权使用,防滥用又保合法应用。

Audio Avatar Fingerprinting: An Approach for Authorized Use of Voice Cloning in the Era of Synthetic Audio

  • 基于非取证领域声纹模型扩展,实现合成语音授权验证。
  • 首次实验证明该模型可检测虚假语音并识别授权身份。
  • 构建新数据集支持合成语音的合法性验证研究。

随着人工智能语音合成技术的发展,仅需目标人物几秒参考音频即可生成逼真的合成语音,使他人‘开口说话’变得轻而易举。这给基于语音的身份认证系统、视频会议及音视频广播平台带来了新的取证挑战,亟需检测合成语音。同时,语音合成也可用于低带宽通信、音频增强等合法场景,因此需要验证合成语音是否确实由用户授权生成。本文提出‘音频化身指纹’(Audio Avatar Fingerprinting)任务,以验证合成语音的授权身份。我们首次将一个非取证背景的现成声纹验证模型拓展至虚假语音检测与身份授权验证任务,并发现现有数据集无法支持此新任务,因而构建了一个新的语音取证数据集以填补空白。

原文摘要 · Abstract (English)

With the advancements in AI speech synthesis, it is easier than ever before to generate realistic audio in a target voice. One only needs a few seconds of reference audio from the target, quite literally putting words in the target person's mouth. This imposes a new set of forensics-related challenges on speech-based authentication systems, videoconferencing, and audio-visual broadcasting platforms, where we want to detect synthetic speech. At the same time, leveraging AI speech synthesis can enhance the different modes of communication through features such as low-bandwidth communication and audio enhancements - leading to ever-increasing legitimate use-cases of synthetic audio. In this case, we want to verify if the synthesized voice is actually spoken by the user. This will require a mechanism to verify whether a given synthetic audio is driven by an authorized identity, or not. We term this task audio avatar fingerprinting. As a step towards audio forensics in these new and emerging situations, we analyze and extend an off-the-shelf speaker verification model developed outside of forensics context for the task of fake speech detection and audio avatar fingerprinting, the first experimentation of its kind. Furthermore, we observe that no existing dataset allows for the novel task of verifying the authorized use of synthetic audio - a limitation which we address by introducing a new speech forensics dataset for this novel task.

语音合成声纹识别安全验证伪造检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。