首个支持语音与环境音混合场景的局部音频伪造检测数据集
PC-Mix: Partial-Component Audio Spoofing Detection under Mixed Speech and Environmental Sound Conditions

- 构建混合语音与环境音的局部伪造数据集,模拟真实场景
- 混合条件下检测难度显著提升,需联合学习框架优化性能
- 适合音频安全、伪造检测方向研究者使用
现有局部音频伪造检测研究多聚焦于录音室录制的语音,且仅关注语音片段的时间定位。然而,这些研究常忽视真实场景中伪造与真实片段同时存在于语音与环境音成分中的情况。本文提出PC-Mix,首个针对部分组件伪造检测的数据集,其中语音或环境音任一或两者均可能被局部篡改。在该数据集中,真实与部分伪造的环境音成分首先构建,并与已有局部伪造数据集中的语音信号混合,生成语音与环境音共同受局部操控的音频。该设计填补了现有局部伪造基准的两大空白:语音局部伪造场景中缺乏真实环境音,以及环境音成分缺乏局部伪造检测。我们进一步建立标准化评估协议,并设计联合学习框架,以优化语音、环境音及混合音频中的伪造检测。实验表明,混合条件显著增加检测难度;结果还显示,在匹配目标条件下训练比直接迁移语音或环境音模型更有效。
原文摘要 · Abstract (English)
Recent studies on partial audio spoofing mainly focus on studio-recorded speech with temporal localization of spoofed segments. However, these studies often overlook realistic conditions where spoofed and bonafide segments simultaneously coexist across speech and environmental sound components. In this paper, we present PC-Mix, the first dataset for partial-component spoofing detection, where either or both audio components may be partially spoofed. In PC-Mix, bonafide and partially spoofed environmental-sound components are first constructed and mixed with speech signals from an existing partial-spoof dataset, producing audio in which either or both components may be locally manipulated. This design addresses two major gaps in existing partial spoofing benchmarks: the lack of realistic environmental sounds in speech partial spoofing scenarios and the absence of partial spoofing detection for environmental sound components. We further establish standardized evaluation protocols and design a joint learning framework to optimize spoofing detection across speech, environmental sound, and mixed audio. Experiments highlight the increased difficulty introduced by mixed conditions. The results demonstrate that training under matched target conditions is more effective than directly transferring models trained on speech or environmental sound components.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。