用自适应注意力提升语音抑郁检测,更准更可解释。
Density Adaptive Attention-based Speech Network: Enhancing Feature Understanding for Mental Health Disorders
- 引入密度自适应注意力机制,动态聚焦关键语音片段。
- 在DAIC-WOZ数据集上达0.72的宏F1分数,优于以往方法。
- 模型轻量可解释,适合临床辅助诊断场景。
基于语音的抑郁症检测因个体差异显著和数据稀缺面临挑战。本文提出DAAMAudioCNNLSTM与DAAMAudioTransformer两种参数高效且可解释的模型,用于音频特征提取与抑郁检测。前者采用融合多头密度自适应注意力机制(DAAM)的CNN-LSTM架构,动态关注语义信息丰富的语音段;后者以Transformer编码器替代CNN-LSTM,同样集成DAAM模块以增强注意力与可解释性。两模型在不依赖音素位置或说话人信息的前提下,于DAIC-WOZ数据集上分别取得0.702与0.72的宏F1分数,显著提升检测鲁棒性与可解释性。模型在利用语音信号进行抑郁识别方面的高效性与透明性,为构建更可靠、临床可用的诊断工具带来突破,有望推动语音与心理健康医疗的发展。代码已开源,以促进该领域研究。
原文摘要 · Abstract (English)
Speech-based depression detection poses significant challenges for automated detection due to its unique manifestation across individuals and data scarcity. Addressing these challenges, we introduce DAAMAudioCNNLSTM and DAAMAudioTransformer, two parameter efficient and explainable models for audio feature extraction and depression detection. DAAMAudioCNNLSTM features a novel CNN-LSTM framework with multi-head Density Adaptive Attention Mechanism (DAAM), focusing dynamically on informative speech segments. DAAMAudioTransformer, leveraging a transformer encoder in place of the CNN-LSTM architecture, incorporates the same DAAM module for enhanced attention and interpretability. These approaches not only enhance detection robustness and interpretability but also achieve state-of-the-art performance: DAAMAudioCNNLSTM with an F1 macro score of 0.702 and DAAMAudioTransformer with an F1 macro score of 0.72 on the DAIC-WOZ dataset, without reliance on supplementary information such as vowel positions and speaker information during training/validation as in previous approaches. Both models' significant explainability and efficiency in leveraging speech signals for depression detection represent a leap towards more reliable, clinically useful diagnostic tools, promising advancements in speech and mental health care. To foster further research in this domain, we make our code publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。