提出分诊式知识蒸馏,提升语音验证在低资源设备上的性能
Triage knowledge distillation for speaker verification
- 按样本难度分组教师输出,区分目标、混淆类与背景类
- 通过渐进缩小混淆集,聚焦最难识别的说话人对
- 在VoxCeleb1上实现最低错误率,适用于移动端语音验证
在资源受限设备上部署高容量语音验证模型仍具挑战性;知识蒸馏(KD)提供了解决方案。传统KD在KL散度项中混杂了目标置信度与非目标结构,限制了关系信息的传递。解耦式KD虽分离信号,但对非目标统一处理,在大规模类别设置下仍受低概率类别长尾影响。本文提出分诊知识蒸馏(TRKD),实现‘评估-优先-聚焦’策略:引入累积概率阈值τ,将教师后验分为三类——目标类、高概率混淆集、背景集。为优先传递有效信息,TRKD蒸馏混淆集条件分布并丢弃背景集,同时传递包含样本难度与类间混淆的三质量分布。最后,通过τ的课程学习机制聚焦训练:初期设较大τ以传递广泛的非目标上下文,随后逐步减小τ,缩小混淆集,集中监督最易混淆的类别。在VoxCeleb1上,无论同构还是异构师生对,TRKD均显著优于近期KD方法,并在所有协议下取得最低EER。
原文摘要 · Abstract (English)
Deploying speaker verification on resource-constrained devices remains challenging due to the computational cost of high-capacity models; knowledge distillation (KD) offers a remedy. Classical KD entangles target confidence with non-target structure in a Kullback-Leibler term, limiting the transfer of relational information. Decoupled KD separates these signals into target and non-target terms, yet treats non-targets uniformly and remains vulnerable to the long tail of low-probability classes in large-class settings. We introduce Triage KD (TRKD), a distillation scheme that operationalizes assess-prioritize-focus. TRKD introduces a cumulative-probability cutoff $τ$ to assess per-example difficulty and partition the teacher posterior into three groups: the target class, a high-probability non-target confusion-set, and a background-set. To prioritize informative signals, TRKD distills the confusion-set conditional distribution and discards the background. Concurrently, it transfers a three-mass (target/confusion/background) that capture sample difficulty and inter-class confusion. Finally, TRKD focuses learning via a curriculum on $τ$: training begins with a larger $τ$ to convey broad non-target context, then $τ$ is progressively decreased to shrink the confusion-set, concentrating supervision on the most confusable classes. In extensive experiments on VoxCeleb1 with both homogeneous and heterogeneous teacher-student pairs, TRKD was consistently superior to recent KD variants and attained the lowest EER across all protocols.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。