用手工特征+1D-CNN区分泰米尔语书面与口语,准确率达99.46%
A Feature Engineering Approach for Literary and Colloquial Tamil Speech Classification using 1D-CNN
- 手工设计语音特征捕捉频谱、时序与语调特性
- 结合最优手特征与MFCC,F1达0.9946
- 轻量模型适合实际语音交互系统
在理想的人机交互中,口语形式更受用户欢迎,因其贴近日常对话;但正式文学形式也需保留以维护语言完整性。因此,计算机应能根据需要处理两种语言形式。为此,需先识别输入语音的类型——本文聚焦于泰米尔语的书面与口语分类。提出一种基于一维卷积神经网络(1D-CNN)的前端分类器,该网络学习时间维度上特征包络。初始训练使用一组精心设计的手工特征,随后与梅尔频率倒谱系数(MFCC)对比。手工特征涵盖语音的频谱、时序、韵律和音质等维度。通过分析十组并行语音样本,观察各特征随时间的变化趋势。使用手工特征训练的1D-CNN获得0.9803的F1分数;使用MFCC则达0.9895。进一步进行特征消融与组合分析:将最优手工特征与MFCC结合后,取得最佳性能,F1分数提升至0.9946。
原文摘要 · Abstract (English)
In ideal human computer interaction (HCI), the colloquial form of a language would be preferred by most users, since it is the form used in their day-to-day conversations. However, there is also an undeniable necessity to preserve the formal literary form. By embracing the new and preserving the old, both service to the common man (practicality) and service to the language itself (conservation) can be rendered. Hence, it is ideal for computers to have the ability to accept, process, and converse in both forms of the language, as required. To address this, it is first necessary to identify the form of the input speech, which in the current work is between literary and colloquial Tamil speech. Such a front-end system must consist of a simple, effective, and lightweight classifier that is trained on a few effective features that are capable of capturing the underlying patterns of the speech signal. To accomplish this, a one-dimensional convolutional neural network (1D-CNN) that learns the envelope of features across time, is proposed. The network is trained on a select number of handcrafted features initially, and then on Mel frequency cepstral coefficients (MFCC) for comparison. The handcrafted features were selected to address various aspects of speech such as the spectral and temporal characteristics, prosody, and voice quality. The features are initially analyzed by considering ten parallel utterances and observing the trend of each feature with respect to time. The proposed 1D-CNN, trained using the handcrafted features, offers an F1 score of 0.9803, while that trained on the MFCC offers an F1 score of 0.9895. In light of this, feature ablation and feature combination are explored. When the best ranked handcrafted features, from the feature ablation study, are combined with the MFCC, they offer the best results with an F1 score of 0.9946.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。