arXiv:2409.14769cs.CL2024-09被引 3

跨语言分析抑郁语音特征,提升多语种筛查能力

Language-Agnostic Analysis of Speech Depression Detection

  • 用CNN分析英、马拉雅拉姆语语音中的抑郁特征
  • 在双语数据集上实现有效抑郁检测,支持跨语言应用
  • 基于IViE语料库,适合开发普适性抑郁筛查系统

重度抑郁症(MDD)患者相比健康人群在语音中表现出音调变化。然而这些音调变化不仅与疾病状态相关,也受语言影响,不同语言具有独特的音调模式。本文分析了在英语和马拉雅拉姆语两种语言间基于语音的抑郁检测,这两种语言具有显著的语调和音位特征差异。研究采用来自参与者朗读IViE语料库中五类句子(简单句、疑问句、无形态标记疑问句、倒装疑问句、并列句)的语音数据,结合自评标签,构建双语数据集。使用卷积神经网络(CNN)模型识别与抑郁相关的语音声学特征,模型在包含抑郁与非抑郁发言者的录音数据上进行评估,验证其在双语环境下的有效性。研究结果及所收集数据有助于推动无需语言依赖的语音抑郁检测系统发展,提升对多样化人群的可及性。

原文摘要 · Abstract (English)

The people with Major Depressive Disorder (MDD) exhibit the symptoms of tonal variations in their speech compared to the healthy counterparts. However, these tonal variations not only confine to the state of MDD but also on the language, which has unique tonal patterns. This work analyzes automatic speech-based depression detection across two languages, English and Malayalam, which exhibits distinctive prosodic and phonemic characteristics. We propose an approach that utilizes speech data collected along with self-reported labels from participants reading sentences from IViE corpus, in both English and Malayalam. The IViE corpus consists of five sets of sentences: simple sentences, WH-questions, questions without morphosyntactic markers, inversion questions and coordinations, that can naturally prompt speakers to speak in different tonal patterns. Convolutional Neural Networks (CNNs) are employed for detecting depression from speech. The CNN model is trained to identify acoustic features associated with depression in speech, focusing on both languages. The model's performance is evaluated on the collected dataset containing recordings from both depressed and non-depressed speakers, analyzing its effectiveness in detecting depression across the two languages. Our findings and collected data could contribute to the development of language-agnostic speech-based depression detection systems, thereby enhancing accessibility for diverse populations.

语音分析抑郁检测跨语言CNN

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。