arXiv:2605.07735cs.SD2026-05中稿 · IEEE International…

TARNet通过多尺度时间建模提升说话人识别精度。

TARNet: A Temporal-Aware Multi-Scale Architecture for Closed-Set Speaker Identification

论文配图:TARNet: A Temporal-Aware Multi-Scale Architecture for Closed-Set Speaker Identification
图 1 · 摘自论文原文
  • 设计多阶段膨胀编码器,显式捕捉不同时间尺度的语音特征
  • 在VoxCeleb1和LibriSpeech上超越现有方法,错误率降低1.8%
  • 轻量化设计适合实际部署,代码开源可复现

闭集说话人识别旨在将语音片段分配给预定义的注册说话人之一,需鲁棒地建模跨多时间尺度的说话人特异性。尽管近期深度学习方法表现优异,但许多现有架构对不同时间尺度间时序依赖的建模能力有限,限制了短、中、长时程说话人特征的互补利用。本文提出TARNet,一种面向闭集说话人识别的轻量级时序感知表示网络。TARNet采用具有特定膨胀配置的多阶段时序编码器,显式建模多时间尺度的时序信息。生成的多尺度表征通过注意力统计池化(ASP)模块融合聚合,得到判别性强的语音段级说话人嵌入。在VoxCeleb1和LibriSpeech数据集上的实验表明,TARNet在保持可比计算复杂度的同时,优于当前最优方法,适用于实际说话人识别系统。代码已公开于https://github.com/YassinTERRAF/TARNet。

原文摘要 · Abstract (English)

Closed-Set speaker identification aims to assign a speech utterance to one of a predefined set of enrolled speakers and requires robust modeling of speaker-specific characteristics across multiple temporal scales. While recent deep learning approaches have achieved strong performance, many existing architectures provide limited mechanisms for modeling temporal dependencies across different time scales, which can restrict the effective use of complementary short-, mid-, and long-term speaker characteristics. In this paper, we propose TARNet, a lightweight Temporal-Aware Representation Network for closed-set speaker identification. TARNet explicitly models temporal information at multiple time scales using a multi-stage temporal encoder with stage-specific dilation configurations. The resulting multi-scale representations are fused and aggregated via an Attentive Statistics Pooling (ASP) module to produce a discriminative utterance-level speaker embedding. Experiments on the VoxCeleb1 and LibriSpeech datasets show that TARNet outperforms state-of-the-art methods while maintaining competitive computational complexity, making it suitable for practical speaker identification systems. The code is publicly available at https://github.com/YassinTERRAF/TARNet.

说话人识别多尺度建模轻量模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。