arXiv:2507.19204eess.AScs.CL2025-07被引 3

对比上下文聚类对无监督词切分的影响,发现简单方法也能达到顶尖效果。

Should Top-Down Clustering Affect Boundaries in Unsupervised Word Discovery?

  • 用自监督特征差异判断词边界,再聚类生成词典。
  • 上下文聚类方法在五语言数据集上表现相近,但底层方法快近5倍。
  • 聚类环节是主要瓶颈,建议优化聚类与词表示学习。

本文研究如何将未标注语音分割为类似词的单元并聚类形成词典。现有方法分为两类:自底向上先定边界再聚类,自顶向下则利用聚类信息反馈调整边界。我们比较了两种相似方法,区别在于是否引入自顶向下信息。底向方法基于相邻自监督特征的不相似性预测边界,再聚类生成词典;顶向方法为改进版ES-KMeans动态规划法,迭代使用K-means更新边界。在五个语言的ZeroSpeech基准上,两者均达当前最优水平,且底向方法快近五倍。详细分析表明,顶向信息虽有益(取决于候选边界),但多数情况下底向方法表现相当。两方法中聚类步骤均为主要限制因素。因此建议未来工作聚焦于改进聚类技术与学习更具区分性的词级表征。项目代码仓库:https://github.com/s-malan/prom-seg-clus。

原文摘要 · Abstract (English)

We investigate the problem of segmenting unlabeled speech into word-like units and clustering these to create a lexicon. Prior work can be categorized into two frameworks. Bottom-up methods first determine boundaries and then cluster the fixed segmented words into a lexicon. In contrast, top-down methods incorporate information from the clustered words to inform boundary selection. However, it is unclear whether top-down information is necessary to improve segmentation. To explore this, we look at two similar approaches that differ in whether top-down clustering informs boundary selection. Our simple bottom-up strategy predicts word boundaries using the dissimilarity between adjacent self-supervised features, then clusters the resulting segments to construct a lexicon. Our top-down system is an updated version of the ES-KMeans dynamic programming method that iteratively uses K-means to update its boundaries. On the five-language ZeroSpeech benchmarks, both approaches achieve comparable state-of-the-art results, with the bottom-up system being nearly five times faster. Through detailed analyses, we show that the top-down influence of ES-KMeans can be beneficial (depending on factors like the candidate boundaries), but in many cases the simple bottom-up method performs just as well. For both methods, we show that the clustering step is a limiting factor. Therefore, we recommend that future work focus on improved clustering techniques and learning more discriminative word-like representations. Project code repository: https://github.com/s-malan/prom-seg-clus.

无监督词发现语音分割聚类优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。