通过自适应重校准消除情绪模糊,提升音视频抑郁检测准确率
READ-Net: Clarifying Emotional Ambiguity via Adaptive Feature Recalibration for Audio-Visual Depression Detection
- 提出AFR机制,动态调整情绪特征权重以突出抑郁信号
- 在三个数据集上平均提升4.55%准确率和1.26%F1分数
- 适合需要处理情绪干扰的临床辅助诊断系统使用
抑郁症是全球严重的心理健康问题,影响日常功能与生活质量。尽管近期音视频方法提升了自动抑郁检测性能,但忽略情绪线索的方法难以捕捉隐藏在情绪表达中的细微抑郁信号;而过度依赖情绪信息的方法常将短暂情绪表达误判为稳定抑郁症状,产生称为“情感模糊”的现象,导致检测错误。为此,我们提出READ-Net,首个专为解决情感模糊设计的音视频抑郁检测框架,核心为自适应特征重校准(AFR)。AFR动态调整情绪特征权重,增强抑郁相关信号,创新性地识别并保留情绪特征中与抑郁相关的线索,同时自适应过滤无关情绪噪声。该重校准策略显著清晰化特征表示,有效缓解情绪干扰问题。此外,READ-Net可无缝集成至现有框架。在三个公开数据集上的广泛评估显示,其平均准确率提升4.55%,F1分数提升1.26%,验证了对情绪干扰的鲁棒性,显著提升音视频抑郁检测性能。
原文摘要 · Abstract (English)
Depression is a severe global mental health issue that impairs daily functioning and overall quality of life. Although recent audio-visual approaches have improved automatic depression detection, methods that ignore emotional cues often fail to capture subtle depressive signals hidden within emotional expressions. Conversely, those incorporating emotions frequently confuse transient emotional expressions with stable depressive symptoms in feature representations, a phenomenon termed \emph{Emotional Ambiguity}, thereby leading to detection errors. To address this critical issue, we propose READ-Net, the first audio-visual depression detection framework explicitly designed to resolve Emotional Ambiguity through Adaptive Feature Recalibration (AFR). The core insight of AFR is to dynamically adjust the weights of emotional features to enhance depression-related signals. Rather than merely overlooking or naively combining emotional information, READ-Net innovatively identifies and preserves depressive-relevant cues within emotional features, while adaptively filtering out irrelevant emotional noise. This recalibration strategy significantly clarifies feature representations, and effectively mitigates the persistent challenge of emotional interference. Additionally, READ-Net can be easily integrated into existing frameworks for improved performance. Extensive evaluations on three publicly available datasets show that READ-Net outperforms state-of-the-art methods, with average gains of 4.55\% in accuracy and 1.26\% in F1-score, demonstrating its robustness to emotional disturbances and improving audio-visual depression detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。