让说话人识别模型的隐含表示变得可解释,揭示其层级聚类结构。
Explainable AI in Speaker Recognition -- Making Latent Representations Understandable

- 用SLINK和HDBSCAN挖掘语音模型表示的层级聚类关系。
- 发现表示空间中存在性别与国籍的层次化语义结构。
- 设计新方法量化聚类与语义类别的匹配度,适合模型可解释性研究者。
神经网络能从数据中学习任务相关表示,理解其决策过程属于可解释人工智能(XAI)范畴。本文研究说话人识别模型所学表示的未知组织结构,重点分析其在语音表征空间中的层级聚类现象。以往研究多使用K-means等算法分析平坦聚类,而本文采用Single-Linkage Clustering(SLINK)和Hierarchical Density-Based Spatial Clustering of Applications with Noise(HDBSCAN),探索表示间的层级聚类模式。进一步提出一种名为Hierarchical Cluster-Class Matching(HCCM)的算法,用于语义解读由SLINK分析出的层级聚类结果。该方法识别哪些聚类最匹配性别、国籍等语义类别(如男性、女性、爱尔兰、英国)及其逻辑组合(如女性且爱尔兰)。同时引入Liebig分数评估每个聚类-类别对的匹配质量,并诊断匹配限制因素。
原文摘要 · Abstract (English)
Neural networks can be trained to learn task-relevant representations from data. Understanding how these networks make decisions falls within the Explainable AI (XAI) domain. This paper proposes to study an XAI topic: analysing, visualising and understanding the unknown organisation of network representations, particularly those a speaker recognition network learns from utterances, for recognising speaker identity. Past studies have employed algorithms (e.g. K-means) to analyse the different ways in which network representations can be naturally grouped into clusters, i.e. to analyse different flat clustering phenomena within the space defined by those representations. In contrast, this work applies two algorithms -- Single-Linkage Clustering (SLINK) and Hierarchical Density-Based Spatial Clustering of Applications with Noise (HDBSCAN) -- to analyse the different ways in which representations from the speaker recognition network can form clusters with hierarchical relationships, i.e., to analyse different hierarchical clustering phenomena within the representation space of the speaker recognition network. Furthermore, an algorithm called Hierarchical Cluster-Class Matching (HCCM) is designed to semantically interpret one of the above hierarchical clustering phenomena analysed using SLINK. Given the clusters representing this phenomenon, HCCM identifies which ones best match individual semantic classes related to gender and nationality (e.g.\ male, female, Ireland, UK) and and-logic conjunctions of these classes (e.g.\ female and Ireland). The Liebig score metric is also proposed within HCCM to quantify the matching quality of each cluster-class pair and diagnose the factor that limits each match.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。