用脑电波验证语音抑郁检测模型,跨语言有效且机制可信。
Validating Computational Markers of Depressive Behavior: Cross-Linguistic Speech-Based Depression Detection with Neurophysiological Validation
- 融合情绪化语音提升检测性能,支持情绪唤醒比情感极性更关键。
- 中文数据集上达89.6%的F1分数,与意大利数据集表现相当。
- 首次通过脑电波证实模型预测与抑郁神经标记一致,适合临床辅助诊断。
基于语音的抑郁检测作为客观诊断工具展现出潜力,但其声学特征在跨语言场景下的稳健性及其神经生物学基础仍不明确。本研究将已在意大利语数据上验证的跨数据多层级注意力(CDMA)框架扩展至中文普通话数据集,并结合脑电图(EEG)记录进行分析。系统融合朗读语音与自发性语音,在不同情感效价(正、中、负)下探究情绪唤醒是否比情感极性更影响检测效果。此外,首次建立语音抑郁模型的神经生理学验证,通过关联模型预测结果与情绪面孔加工过程中的神经振荡模式。结果显示,CDMA框架在中文数据集中表现出优异的跨语言泛化能力,达到89.6%的最高F1分数,与此前意大利验证结果相当。情绪效价语音(正负)显著优于中性语音,正负任务表现接近,支持情绪唤醒假说。更重要的是,脑电分析揭示模型生成的抑郁评分与theta和alpha频段神经振荡存在显著相关性,与抑郁症中情绪调节障碍的既定神经标记一致。该一致性结合跨语言鲁棒性,不仅证明CDMA方法具有普遍适用性和神经生理可解释性,也开创了计算心理健康模型神经生理验证的新范式。
原文摘要 · Abstract (English)
Speech-based depression detection has shown promise as an objective diagnostic tool, yet the cross-linguistic robustness of acoustic markers and their neurobiological underpinnings remain underexplored. This study extends Cross-Data Multilevel Attention (CDMA) framework, initially validated on Italian, to investigate these dimensions using a Chinese Mandarin dataset with Electroencephalography (EEG) recordings. We systematically fuse read speech with spontaneous speech across different emotional valences (positive, neutral, negative) to investigate whether emotional arousal is a more critical factor than valence polarity in enhancing detection performance in speech. Additionally, we establish the first neurophysiological validation for a speech-based depression model by correlating its predictions with neural oscillatory patterns during emotional face processing. Our results demonstrate strong cross-linguistic generalizability of the CDMA framework, achieving state-of-the-art performance (F1-score up to 89.6%) on the Chinese dataset, which is comparable to the previous Italian validation. Critically, emotionally valenced speech (both positive and negative) significantly outperformed neutral speech. This comparable performance between positive and negative tasks supports the emotional arousal hypothesis. Most importantly, EEG analysis revealed significant correlations between the model's speech-derived depression estimates and neural oscillatory patterns (theta and alpha bands), demonstrating alignment with established neural markers of emotional dysregulation in depression. This alignment, combined with the model's cross-linguistic robustness, not only supports that the CDMA framework's approach is a universally applicable and neurobiologically validated strategy but also establishes a novel paradigm for the neurophysiological validation of computational mental health models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。