用微调的RoBERTa模型,从社交媒体文本中多类识别六种心理问题。
multiMentalRoBERTa: A Fine-tuned Multiclass Classifier for Mental Health Disorder
- 基于多数据集微调RoBERTa,实现六类心理障碍分类。
- 六分类宏F1达0.839,五分类(去应力)达0.870,优于MentalBERT。
- 结合可解释性方法,区分抑郁与自杀倾向的关键词汇。
从社交媒体文本中早期检测心理健康问题对及时支持、风险评估和资源转介至关重要。本文提出multiMentalRoBERTa,一个针对常见心理障碍(包括压力、焦虑、抑郁、创伤后应激障碍(PTSD)、自杀意念和中性话语)的多类别分类微调RoBERTa模型。基于多个精心整理的数据集,数据分析揭示抑郁与自杀意念、焦虑与PTSD之间存在强相关性,而压力则表现为广泛重叠的类别。与传统机器学习方法、领域特定Transformer及基于提示的大语言模型相比,multiMentalRoBERTa在六分类设置中取得0.839的宏F1,在五分类设置(排除压力)中达0.870,优于微调的MentalBERT和基线分类器。除预测精度外,还采用层积分梯度和KeyBERT等可解释性方法识别驱动分类的词汇线索,尤其关注抑郁与自杀意念的区分。研究强调微调Transformer在敏感场景中可靠且可解释的检测效果,同时强调公平性、偏见缓解及人机协同安全协议的重要性。整体上,multiMentalRoBERTa被呈现为轻量、鲁棒且可部署的心理健康平台增强方案。
原文摘要 · Abstract (English)
The early detection of mental health disorders from social media text is critical for enabling timely support, risk assessment, and referral to appropriate resources. This work introduces multiMentalRoBERTa, a fine-tuned RoBERTa model designed for multiclass classification of common mental health conditions, including stress, anxiety, depression, post-traumatic stress disorder (PTSD), suicidal ideation, and neutral discourse. Drawing on multiple curated datasets, data exploration is conducted to analyze class overlaps, revealing strong correlations between depression and suicidal ideation as well as anxiety and PTSD, while stress emerges as a broad, overlapping category. Comparative experiments with traditional machine learning methods, domain-specific transformers, and prompting-based large language models demonstrate that multiMentalRoBERTa achieves superior performance, with macro F1-scores of 0.839 in the six-class setup and 0.870 in the five-class setup (excluding stress), outperforming both fine-tuned MentalBERT and baseline classifiers. Beyond predictive accuracy, explainability methods, including Layer Integrated Gradients and KeyBERT, are applied to identify lexical cues that drive classification, with a particular focus on distinguishing depression from suicidal ideation. The findings emphasize the effectiveness of fine-tuned transformers for reliable and interpretable detection in sensitive contexts, while also underscoring the importance of fairness, bias mitigation, and human-in-the-loop safety protocols. Overall, multiMentalRoBERTa is presented as a lightweight, robust, and deployable solution for enhancing support in mental health platforms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。