分组件融合提升语音与环境音伪造检测精度
Component-Level Ensemble Fusion for Speech and Environmental Sound Deepfake Detection
- 分组件设计四模型集成,分别识别原始、语音、环境音真伪
- 通过增广训练与分数融合,测试集宏F1达0.7828
- 适合音频安全与伪造检测研究者参考
本文介绍我们参加ICME 2026 ESDD2挑战赛的方案,任务是五分类音频检测:语音、环境音、两者均被伪造,或均未被伪造。我们提出基于四个公开预训练反伪造模型(XLSR-Mamba、DF-Arena、SLS、TCM-ADD)的组件级集成系统。各模型在官方CompSpoofV2开发数据上使用三个二分类头(原始、语音、环境音)进行微调。进一步训练了RawBoost增广变体,并采用边际空间分数融合策略。通过轻量级头与类别偏置校准的组件融合策略,最优配置在评估集上取得0.7715的宏F1,测试集达0.7828,排名31支队伍中第5位,显著优于官方基线。
原文摘要 · Abstract (English)
This paper describes our submission to the ICME 2026 ESDD2 challenge on environment-aware speech and sound deepfake detection. The task requires five-class classification of audio clips in which speech, environmental sound, both components, or neither component may be spoofed. We propose a component-level ensemble system based on four publicly available pre-trained anti-spoofing models: XLSR-Mamba, DF-Arena, SLS, and TCM-ADD. Each model is fine-tuned on the official CompSpoofV2 development data using three binary heads for original, speech, and environmental sound detection. We further train RawBoost-augmented variants and combine selected checkpoints using margin-space score fusion. A component-wise fusion strategy with lightweight head- and class-bias calibration yields our best configuration, reaching 0.7715 macro-F1 on the evaluation set and 0.7828 macro-F1 on the test set, ranking 5th out of 31 teams in the final ranking phase and substantially outperforming the official baseline.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。