arXiv:2606.02980cs.SDcs.CY2026-06

提出高效Transformer反欺骗模型,提升语音验证安全性。

A Training-Efficient Transformer-Based Anti-Spoofing Network for Logical Access in ASVspoof 5

  • 用Transformer+焦点对损失实现精准语音伪造检测
  • 最小DCF达0.2430,错误率12.52%,性能超越基线
  • 推理内存仅1.4GB,速度0.79毫秒/句,训练更快

合成与篡改语音会降低自动说话人验证系统的可靠性,因此反欺骗方法需兼顾准确性和训练推理效率。本文针对ASVspoof 5 Track 1封闭场景,提出TFPARN——一种基于Transformer的焦点对注意力排序网络。该系统从语音中提取log-Mel特征,经Transformer编码器建模帧级信息,再通过注意力池化获得语句级表示,并采用焦点分类损失与成对排序损失联合训练。训练中使用RawBoost增强,评估时应用测试时增强以提升鲁棒性。在相同协议下,相比重新实现的AASIST和RawNet2基线,TFPARN取得最佳结果:minDCF为0.2430,EER为12.52%。消融实验表明,成对损失、焦点损失及注意力池化均有效提升性能。此外,TFPARN推理内存最低(1.4 GB),单句处理仅需约0.79毫秒,且比AASIST更早达到最优模型。结果表明,TFPARN在逻辑访问反欺骗中实现了检测精度与计算成本的良好平衡。

原文摘要 · Abstract (English)

Synthetic and manipulated speech can reduce the reliability of automatic speaker verification systems, so anti-spoofing methods need to be both accurate and efficient in training and inference. This paper focuses on the ASVspoof 5 Track 1 closed condition, where standard cross-entropy training may not give enough attention to hard trials and is not directly aligned with ranking- and threshold-based evaluation metrics. We propose TFPARN, a Transformer-based focal-pairwise attentive ranking network. The system extracts log-Mel features from speech, uses a Transformer encoder to model frame-level information, applies attention pooling to obtain utterance-level representations, and is trained with a combination of focal classification loss and pairwise ranking loss. RawBoost augmentation is used during training, and test-time augmentation is applied during evaluation to improve robustness. Compared with re-implemented AASIST and RawNet2 baselines under the same protocol, TFPARN achieves the best results, with a minDCF of 0.2430 and an EER of 12.52%. Ablation experiments further show that the pairwise loss, focal loss, and attention pooling all improve performance. TFPARN also uses the lowest inference memory among the compared systems, at 1.4 GB, runs at about 0.79 ms per utterance, and reaches its best checkpoint in less training time than AASIST. These results show that TFPARN provides a good balance between detection accuracy and computational cost for logical access anti-spoofing.

语音反欺骗Transformer高效模型ASVspoof

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。