arXiv:2411.15404cs.LGcs.CL2024-11ICML被引 19

对比多种模型在社交媒体上识别自杀倾向,RoBERTa表现最佳。

A Comparative Analysis of Transformer and LSTM Models for Detecting Suicidal Ideation on Reddit

  • 用Transformer和LSTM模型分析Reddit用户发帖中的自杀倾向
  • RoBERTa准确率达93.22%,F1为93.14%,最优
  • 适合关注心理健康监测与NLP应用的研究者

自杀是全球重大健康问题,每年导致逾70万例死亡,尤其影响年轻群体。许多人在社交平台如Reddit上表达自杀想法。本文评估了基于Transformer的BERT、RoBERTa、DistilBERT、ALBERT、ELECTRA以及多种LSTM模型在检测Reddit用户帖子中自杀倾向的有效性。为此,我们从多个子版块构建了大规模数据集,并通过语言学、主题建模和统计分析确保数据质量。结果表明,各模型均达到高准确率和F1分数,其中RoBERTa表现最优,准确率为93.22%,F1得分为93.14%;使用注意力机制和BERT嵌入的LSTM模型位列第二,准确率为92.65%,F1为92.69%。研究显示,Transformer模型在自杀倾向检测方面具有潜力,可助力开发基于社交媒体的稳健心理健康监控工具,凸显先进自然语言处理技术在提升自杀预防能力方面的前景。

原文摘要 · Abstract (English)

Suicide is a critical global health problem involving more than 700,000 deaths yearly, particularly among young adults. Many people express their suicidal thoughts on social media platforms such as Reddit. This paper evaluates the effectiveness of the deep learning transformer-based models BERT, RoBERTa, DistilBERT, ALBERT, and ELECTRA and various Long Short-Term Memory (LSTM) based models in detecting suicidal ideation from user posts on Reddit. Toward this objective, we curated an extensive dataset from diverse subreddits and conducted linguistic, topic modeling, and statistical analyses to ensure data quality. Our results indicate that each model could reach high accuracy and F1 scores, but among them, RoBERTa emerged as the most effective model with an accuracy of 93.22% and F1 score of 93.14%. An LSTM model that uses attention and BERT embeddings performed as the second best, with an accuracy of 92.65% and an F1 score of 92.69%. Our findings show that transformer-based models have the potential to improve suicide ideation detection, thereby providing a path to develop robust mental health monitoring tools from social media. This research, therefore, underlines the undeniable prospect of advanced techniques in Natural Language Processing (NLP) while improving suicide prevention efforts.

自杀检测TransformerNLPReddit

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。