将语音伪造检测拆解为定位与分类两阶段,提升局部伪造识别精度。
Split and Conquer Partial Deepfake Speech

- 先定位伪造片段边界,再分段独立判断真伪,任务更清晰。
- 在PartialSpoof上多分辨率检测均达顶尖水平,定位准确率显著提升。
- 适合需要精确定位伪造区域的反伪造系统开发者使用。
局部深度伪造语音检测需识别短时片段中的篡改区域,传统整体语音分类器难以应对。本文提出分而治之框架,分为边界检测与分段分类两阶段:边界检测器识别时间转换点,将音频划分为内容一致的段落;每段独立评估真伪。该设计明确分离定位与真伪判断,降低学习复杂度。为进一步提升鲁棒性,引入基于反射的多长度训练策略,将不同长度段落转为固定输入,生成多样化特征表示。各阶段采用多种特征提取器与增强策略训练,融合互补预测结果。在PartialSpoof基准测试中,模型在多个时间分辨率及整体语音层面均达领先性能,显著提升伪造区域检测与定位精度。同时在Half-Truth数据集上也取得最优表现,验证了框架的鲁棒性与泛化能力。
原文摘要 · Abstract (English)
Partial deepfake speech detection requires identifying manipulated regions that may occur within short temporal portions of an otherwise bona fide utterance, making the task particularly challenging for conventional utterance-level classifiers. We propose a split-and-conquer framework that decomposes the problem into two stages: boundary detection and segment-level classification. A dedicated boundary detector first identifies temporal transition points, allowing the audio signal to be divided into segments that are expected to contain acoustically consistent content. Each resulting segment is then evaluated independently to determine whether it corresponds to bona fide or fake speech. This formulation simplifies the learning objective by explicitly separating temporal localization from authenticity assessment, allowing each component to focus on a well-defined task. To further improve robustness, we introduce a reflection-based multi-length training strategy that converts variable-duration segments into several fixed input lengths, producing diverse feature-space representations. Each stage is trained using multiple configurations with different feature extractors and augmentation strategies, and their complementary predictions are fused to obtain improved final models. Experiments on the PartialSpoof benchmark demonstrate state-of-the-art performance across multiple temporal resolutions as well as at the utterance level, with substantial improvements in the accurate detection and localization of spoofed regions. In addition, the proposed method achieves state-of-the-art performance on the Half-Truth dataset, further confirming the robustness and generalization capability of the framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。