arXiv:2502.00310cs.SDcs.AI2025-02被引 6

用可学习小波网络直接从原始语音中识别情绪,效果超越现有方法。

SigWavNet: Learning Multiresolution Signal Wavelet Network for Speech Emotion Recognition

  • 基于小波变换构建可学习的多分辨率特征提取框架。
  • 在IEMOCAP和EMO-DB上达到新高,无需分段或预处理。
  • 融合注意力机制与空时卷积,精准捕捉情绪时空特征。

在人机交互与心理评估领域,语音情感识别(SER)致力于从语音信号中解析情绪状态。尽管已有进展,仍面临系统复杂、特征区分度不足及噪声干扰等挑战。本文提出一种端到端深度学习多分辨率框架,直接从原始波形中提取有意义表征。通过利用快速离散小波变换(FDWT)的级联算法、共轭对称滤波器及系数去噪特性,引入可学习的小波基与去噪模型。设计可学习的非对称硬阈值激活函数以优化小波系数。该方法充分发挥小波在时频域的局部化能力。随后结合一维空洞卷积神经网络(1D dilated CNN)、空间注意力层,以及双向门控循环单元(Bi-GRU)与时间注意力层,有效捕捉情感特征的细微时空模式。模型支持变长语音输入,无需分段或预/后处理,在IEMOCAP和EMO-DB数据集上表现优于当前最优方法。代码已开源:https://github.com/alaaNfissi/SigWavNet-Learning-Multiresolution-Signal-Wavelet-Network-for-Speech-Emotion-Recognition。

原文摘要 · Abstract (English)

In the field of human-computer interaction and psychological assessment, speech emotion recognition (SER) plays an important role in deciphering emotional states from speech signals. Despite advancements, challenges persist due to system complexity, feature distinctiveness issues, and noise interference. This paper introduces a new end-to-end (E2E) deep learning multi-resolution framework for SER, addressing these limitations by extracting meaningful representations directly from raw waveform speech signals. By leveraging the properties of the fast discrete wavelet transform (FDWT), including the cascade algorithm, conjugate quadrature filter, and coefficient denoising, our approach introduces a learnable model for both wavelet bases and denoising through deep learning techniques. The framework incorporates an activation function for learnable asymmetric hard thresholding of wavelet coefficients. Our approach exploits the capabilities of wavelets for effective localization in both time and frequency domains. We then combine one-dimensional dilated convolutional neural networks (1D dilated CNN) with a spatial attention layer and bidirectional gated recurrent units (Bi-GRU) with a temporal attention layer to efficiently capture the nuanced spatial and temporal characteristics of emotional features. By handling variable-length speech without segmentation and eliminating the need for pre or post-processing, the proposed model outperformed state-of-the-art methods on IEMOCAP and EMO-DB datasets. The source code of this paper is shared on the Github repository: https://github.com/alaaNfissi/SigWavNet-Learning-Multiresolution-Signal-Wavelet-Network-for-Speech-Emotion-Recognition.

语音情感识别小波网络端到端

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。