arXiv:2507.19511cs.CLcs.LG2025-07被引 13

对比多种模型在社交媒体上识别心理疾病,Transformer表现更优。

Advancing Mental Disorder Detection: A Comparative Evaluation of Transformer and LSTM Architectures on Social Media

  • 用BERT等变换器模型比LSTM更擅长从社交文本中识别心理疾病。
  • RoBERTa在测试集上达到99.54%的F1分数,外部数据集也达96.05%。
  • 用BERT嵌入增强的LSTM模型仅需少量算力,仍能保持94%以上准确率。

心理疾病发病率上升,亟需可靠的自动化检测工具。本研究全面评估了BERT、RoBERTa、DistilBERT、ALBERT和ELECTRA等前沿变换器模型,以及基于不同文本嵌入的LSTM方法,在Reddit上的心理健康障碍分类表现。构建了一个大规模标注数据集,并通过统计判断分析和主题建模验证其可靠性。实验结果表明,变换器模型显著优于传统深度学习方法。RoBERTa在保留测试集上取得99.54%的F1分数,在外部测试集上达到96.05%。值得注意的是,使用BERT嵌入增强的LSTM模型在外部数据集上F1分数超过94%,且计算资源需求显著更低。这些发现凸显了变换器模型在实时、可扩展的心理健康监测中的有效性。文章还讨论了其在临床应用与数字心理干预中的意义,揭示了当前NLP技术在心理障碍检测中的能力与局限。

原文摘要 · Abstract (English)

The rising prevalence of mental health disorders necessitates the development of robust, automated tools for early detection and monitoring. Recent advances in Natural Language Processing (NLP), particularly transformer-based architectures, have demonstrated significant potential in text analysis. This study provides a comprehensive evaluation of state-of-the-art transformer models (BERT, RoBERTa, DistilBERT, ALBERT, and ELECTRA) against Long Short-Term Memory (LSTM) based approaches using different text embedding techniques for mental health disorder classification on Reddit. We construct a large annotated dataset, validating its reliability through statistical judgmental analysis and topic modeling. Experimental results demonstrate the superior performance of transformer models over traditional deep-learning approaches. RoBERTa achieved the highest classification performance, with a 99.54% F1 score on the hold-out test set and a 96.05% F1 score on the external test set. Notably, LSTM models augmented with BERT embeddings proved highly competitive, achieving F1 scores exceeding 94% on the external dataset while requiring significantly fewer computational resources. These findings highlight the effectiveness of transformer-based models for real-time, scalable mental health monitoring. We discuss the implications for clinical applications and digital mental health interventions, offering insights into the capabilities and limitations of state-of-the-art NLP methodologies in mental disorder detection.

心理检测TransformerNLP社交文本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。