arXiv:2607.22794cs.LGcs.AI2026-07中稿 · publication in IEE…

用注意力BiLSTM+对抗训练,提升跨患者抑郁检测的泛化能力。

Multimodal Domain Generalization for Depression Detection: An Attention-Based BiLSTM Network with Domain-Adversarial Training

论文配图:Multimodal Domain Generalization for Depression Detection: An Attention-Based BiLSTM Network with Domain-Adversarial Training
图 1 · 摘自论文原文
  • 融合音频与文本的双向LSTM加跨模态注意力,分段融合决策。
  • 在30秒片段上达94.2% F1分数,比基线提升3.3%。
  • 适合做跨患者抑郁筛查的模型,尤其关注减少个体偏差。

基于深度学习的自动抑郁检测虽有前景,但常因说话人差异导致的领域偏移而泛化能力差。为此,我们提出首个不依赖具体患者的多模态抑郁检测框架,结合领域泛化(DG)技术,同时利用语音和文本模态。模型采用双向长短时记忆网络(BiLSTM),融入模内与跨模态注意力机制,并进行分段级融合以做出判断。通过引入受DANN启发的梯度反转层,使模型难以识别具体说话人,从而学习领域不变表示,有效降低患者特异性偏差。在Androids-Corpus数据集上,采用5折交叉验证,不同音视频特征提取器与片段长度组合测试后,确定梅尔频谱(MelSpec)与ItalianBERT为最优基线,30秒片段时表现最佳。在此基础上加入领域泛化,准确率提升2.5%,F1分数提升3.3%,最终达到93.2%准确率、93.2%精确率、96.2%召回率和94.2% F1分数,超越所有现有基准。大量消融实验验证了多模态融合、深层结构选择与领域泛化的协同作用,证明其对鲁棒且可泛化的抑郁检测至关重要。

原文摘要 · Abstract (English)

Automatic depression detection with deep learning has shown promise but often suffers from limited generalization due to domain shift arising from inter-speaker variability. To address this critical issue, we present the first patient-independent multimodal depression detection framework that incorporates domain generalization (DG), jointly leveraging both acoustic and textual modalities. The proposed model integrates bidirectional Long Short-Term Memory (BiLSTM) with intra- and cross-modal attention mechanisms, accompanied by segment-level fusion for decision-making. Generalization is further enhanced by applying a gradient reversal layer inspired by Domain-Adversarial Training of Neural Networks (DANN), which promotes domain-invariant representations by adversarially limiting the model's ability to identify individual speakers, effectively reducing patient-specific bias. Conducting experiments on the Androids-Corpus dataset with a 5-fold cross-validation (CV) protocol, various pairings of audio and text feature extractors were evaluated over different segment durations, determining MelSpec and ItalianBERT as the optimal baseline at a 30-second segment duration. The addition of DG to this baseline yields a 2.5% increase in accuracy and 3.3% in F1-score, achieving 93.2% accuracy, 93.2% precision, 96.2% recall, and 94.2% F1-score, surpassing all existing benchmarks. Extensive ablation studies assess the impact of multimodal fusion, deep architectural choices, and DG, highlighting their combined contribution to robust and generalizable depression detection.

抑郁检测多模态领域泛化BiLSTM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。