提出新评估方法，精准衡量语音编码与发音转写的一致性。
Evaluation of Phonetic Encoding Algorithms on Transcription Datasets
- 用改进的兰德指数衡量语音编码与音标转写的相似度。
- 在多语言数据集上验证了多种编码器性能，给出碰撞率与召回率。
- 可拓展用于分析语言拼写系统的语音透明度，适合语音处理研究者。
本文提出一种基于广义兰德指数变体——胡勒迈尔-里夫基指数的新评估方案，用于评估语音编码算法在国际音标（IPA）转写中的表现一致性。通过计算真实转写与对应语音编码之间的成对相似度绝对差值，采用归一化编辑距离作为依赖排列的字符串度量。所得分数经由同字母表随机生成器基准进行校正。在多语言转写数据集上广泛评估了多种语音编码器，并基于碰撞率分析其召回能力。该方法的有效性还体现在将书写系统视为内在语音表示时，可用于衡量语言的正字法透明度。
原文摘要 · Abstract (English)
In this work, a novel evaluation scheme built on a generalized variant of the Rand Index measure, namely, the H\"ullermeier-Rifqi Index, is proposed in order to assess how well phonetic encoding algorithms conform to word-based transcriptions in IPA (International Phonetic Alphabet) notation. For this objective, the discordance score is obtained by calculating the absolute difference between the pairwise similarity values of ground-truth transcriptions and those of corresponding phonetic encodings, which are computed using normalized edit distance as a permutation dependent string metric. The resulting score is subsequently adjusted with respect to that of a random string generator incorporating the same alphabet as the encoder under consideration. A wide range of phonetic encoders were evaluated as such on multi-lingual transcription datasets along with their recall capabilities based on the collision rate. The validity of the proposed scheme is further supported by its applicability in measuring the orthographic transparency of a language when the writing system is viewed as an inherent phonetic representation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。