机器学习可自动区分语音中社会性声带颤音的高低程度。
Can a Machine Distinguish High and Low Amount of Social Creak in Speech?
- 用机器学习模型基于频谱特征区分高/低声带颤音
- 最佳模型准确率达71.1%,使用梅尔频谱图或梅尔倒谱系数
- 为未来研究提供可复用的基准方法,适合语音分析与语言学研究者
目的:近年来,女性说话人中社会性声带颤音(social creak)的出现频率上升。以往研究通过听觉评估结合传统声学参数(如谐噪比、倒谱峰幅度)进行分析。本研究采用机器学习(ML)方法,自动区分低量与高量声带颤音的语音样本。方法:对90位芬兰女性说话人产生的连续语音样本,由两名语音专家进行听觉评估,并据此划分为高/低颤音两类。利用语音信号及其标签,训练了七种不同机器学习模型,每种模型使用三种频谱表示作为输入特征。结果:表现最佳的两个系统准确率达71.1%:一是基于梅尔频谱图的自适应提升分类器(Adaboost),二是基于梅尔倒谱系数的决策树分类器。结论:声带颤音研究在社会语言学和嗓音学中日益重要。传统人工听觉评估耗时费力,机器学习技术可有效辅助研究。本文报告的分类系统可作为未来基于机器学习的社会性声带颤音研究的基准。
原文摘要 · Abstract (English)
Objectives: ncreased prevalence of social creak particularly among female speakers has been reported in several studies. The study of social creak has been previously conducted by combining perceptual evaluation of speech with conventional acoustical parameters such as the harmonic-to-noise ratio and cepstral peak prominence. In the current study, machine learning (ML) was used to automatically distinguish speech of low amount of social creak from speech of high amount of social creak. Methods: The amount of creak in continuous speech samples produced in Finnish by 90 female speakers was first perceptually assessed by two voice specialists. Based on their assessments, the speech samples were divided into two categories (low $vs$. high amount of creak). Using the speech signals and their creak labels, seven different ML models were trained. Three spectral representations were used as feature for each model. Results: The results show that the best performance (accuracy of 71.1\%) was obtained by the following two systems: an Adaboost classifier using the mel-spectrogram feature and a decision tree classifier using the mel-frequency cepstral coefficient feature. Conclusions: The study of social creak is becoming increasingly popular in sociolinguistic and vocological research. The conventional human perceptual assessment of the amount of creak is laborious and therefore ML technology could be used to assist researchers studying social creak. The classification systems reported in this study could be considered as baselines in future ML-based studies on social creak.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。