arXiv:2604.25938cs.SDcs.AI2026-04

用梅尔频谱系数和LSTM识别语音情绪,准确率达99%。

Speech Emotion Recognition Using MFCC Features and LSTM-Based Deep Learning Model

  • 提取语音的梅尔频谱系数,用LSTM捕捉时序情绪特征。
  • 在TESS数据集上达到99%准确率,优于SVM的98%。
  • 适合虚拟助手、心理健康监测等实际场景使用。

语音情绪识别(SER)是基于语音检测人类情感状态的技术,在人机自然交互中日益重要。语音蕴含丰富的情绪信息,如音高、能量和时间模式的变化。然而,由于说话人差异和环境变化,情绪间声音相似性高,使得识别困难。本文提出一种基于梅尔频率倒谱系数(MFCC)和长短期记忆(LSTM)神经网络的语音情绪识别系统。对多伦多情感语音集(TESS)进行预处理,提取MFCC特征以捕捉时间维度关键信息,并输入LSTM模型学习序列音频的长期依赖关系。实验结果显示,该方法在多个情绪类别上表现优异,分类结果高度真实。与采用径向基函数核的支持向量机(SVM)基准模型(98%准确率)相比,所提的MFCC-LSTM模型达到99%准确率。研究证实,基于LSTM的架构可有效应用于语音情绪识别任务。该系统可用于虚拟助手、心理健康监测等实际场景。

原文摘要 · Abstract (English)

Speech Emotion Recognition (SER) is the use of machines to detect the emotional state of humans based on the speech, which is gaining importance in natural human-computer interaction. Speech is a very valuable source of information, as emotions modify the patterns of speech; pitch, energy and even timing. Nonetheless, SER is not an easy task because speakers are not constant, and situations vary when recording and the sound similarity between specific feelings. In this work, the author introduces a speech emotion recognition system relying on the Mel-Frequency Cepstral Coefficient and Long Short-Term Memory (LSTM) neural network, as a feature extraction method. The Toronto Emotional Speech Set (TESS) speech signal was pre-processed, and transformed into MFCC features to understand the important aspects in terms of time. The resultant features were then introduced to LSTM model, which is able to learn long term features of sequential audio data. The trained model was measured over several emotion classes occurring in the dataset. As seen in the results of experiments, the proposed MFCC-LSTM approach succeeds in capturing the patterns of emotions in speech and provides highly realistic classifications in all the chosen emotion classifications. This study presents a speech emotion recognition system using Mel-Frequency Cepstral Coefficients (MFCCs) as features and a deep learning LSTM classifier. A Support Vector Machine (SVM) with an RBF kernel served as a classical baseline, achieving 98% accuracy, against which the proposed LSTM model, achieving 99% accuracy, was validated. Overall, it is possible to confirm that LSTM-based architectures can be used to address the task of speech emotion recognition. Actual applications of the proposed system may be virtual assistants and mental health surveillance.

语音识别情绪分析LSTMMFCC

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。