arXiv:2511.20001cs.CLcs.SI2025-11被引 1

用AI从社交媒体识别10类心理问题与网络霸凌,准确率达92%。

A Machine Learning Approach for Detection of Mental Health Conditions and Cyberbullying from Social Media

  • 构建统一多分类框架,结合微博与Reddit数据训练
  • 微调版MentalBERT模型准确率92%,宏F1达0.76
  • 提供可解释的可视化工具,供内容审核员辅助决策

心理健康问题与网络霸凌在数字空间日益普遍,亟需可扩展且可解释的检测系统。本文提出一个统一的多类别分类框架,从社交媒体数据中识别十类心理状态与网络霸凌。我们收集了来自Twitter和Reddit的数据,采用“先分割后平衡”的流程,在平衡数据上训练,但在真实分布的不平衡测试集上评估。通过对比传统词法模型、混合方法及多个端到端微调的Transformer模型,结果表明端到端微调对性能至关重要,领域自适应的MentalBERT表现最佳,准确率为0.92,宏F1为0.76,优于通用模型和零样本LLM基线。基于全面的伦理分析,系统定位为人工介入的筛查辅助工具,非诊断工具。为此,我们提出一种混合的SHAPLLM可解释性框架,并开发原型仪表板(“社交媒体筛查器”),将模型预测与解释融入实际审核流程。本研究提供了一个稳健基线,凸显未来在多标签、临床验证数据集方面的迫切需求,聚焦在线安全与计算心理健康交叉领域。

原文摘要 · Abstract (English)

Mental health challenges and cyberbullying are increasingly prevalent in digital spaces, necessitating scalable and interpretable detection systems. This paper introduces a unified multiclass classification framework for detecting ten distinct mental health and cyberbullying categories from social media data. We curate datasets from Twitter and Reddit, implementing a rigorous "split-then-balance" pipeline to train on balanced data while evaluating on a realistic, held-out imbalanced test set. We conducted a comprehensive evaluation comparing traditional lexical models, hybrid approaches, and several end-to-end fine-tuned transformers. Our results demonstrate that end-to-end fine-tuning is critical for performance, with the domain-adapted MentalBERT emerging as the top model, achieving an accuracy of 0.92 and a Macro F1 score of 0.76, surpassing both its generic counterpart and a zero-shot LLM baseline. Grounded in a comprehensive ethical analysis, we frame the system as a human-in-the-loop screening aid, not a diagnostic tool. To support this, we introduce a hybrid SHAPLLM explainability framework and present a prototype dashboard ("Social Media Screener") designed to integrate model predictions and their explanations into a practical workflow for moderators. Our work provides a robust baseline, highlighting future needs for multi-label, clinically-validated datasets at the critical intersection of online safety and computational mental health.

心理健康网络霸凌可解释性文本分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。