arXiv:2410.10323cs.CL2024-10EMNLP被引 8

首个面向中文社交媒体的心理健康可解释大模型,支持多任务分析与决策解释。

MentalGLM Series: Explainable Large Language Models for Mental Health Analysis on Chinese Social Media

  • 基于5万条指令训练,构建首个中文心理健康可解释大模型系列。
  • 在3个下游任务中表现优于或媲美深度学习与通用大模型。
  • 提供专家验证的决策解释,适合临床与心理健康研究场景使用。

随着心理健康问题日益普遍,社交媒体成为人们表达情绪的重要平台。深度学习虽具潜力,但其黑箱特性导致任务切换灵活性差且结果缺乏解释。大语言模型(LLMs)因生成性具备解释能力,但在复杂心理分析上仍表现不足。本文提出首个多任务中文社交媒体可解释心理健康指令数据集C-IMHI,包含9,000条经人工验证的样本,并构建MentalGLM系列模型,该系列为首个专用于中文社交媒体心理健康分析的开源可解释大模型,基于5万条指令语料训练。在三个下游任务中,MentalGLM性能优于或媲美深度学习模型、通用大模型及任务微调的大模型。部分生成的决策解释经专家验证,结果良好。在临床数据集上的评估中,MentalGLM优于其他大模型,表明其临床应用潜力。模型性能在多任务与多视角下均获验证,决策解释显著提升可用性与实际应用价值。数据集与模型已开源:https://github.com/zwzzzQAQ/MentalGLM。

原文摘要 · Abstract (English)

As the prevalence of mental health challenges, social media has emerged as a key platform for individuals to express their emotions.Deep learning tends to be a promising solution for analyzing mental health on social media. However, black box models are often inflexible when switching between tasks, and their results typically lack explanations. With the rise of large language models (LLMs), their flexibility has introduced new approaches to the field. Also due to the generative nature, they can be prompted to explain decision-making processes. However, their performance on complex psychological analysis still lags behind deep learning. In this paper, we introduce the first multi-task Chinese Social Media Interpretable Mental Health Instructions (C-IMHI) dataset, consisting of 9K samples, which has been quality-controlled and manually validated. We also propose MentalGLM series models, the first open-source LLMs designed for explainable mental health analysis targeting Chinese social media, trained on a corpus of 50K instructions. The proposed models were evaluated on three downstream tasks and achieved better or comparable performance compared to deep learning models, generalized LLMs, and task fine-tuned LLMs. We validated a portion of the generated decision explanations with experts, showing promising results. We also evaluated the proposed models on a clinical dataset, where they outperformed other LLMs, indicating their potential applicability in the clinical field. Our models show strong performance, validated across tasks and perspectives. The decision explanations enhance usability and facilitate better understanding and practical application of the models. Both the constructed dataset and the models are publicly available via: https://github.com/zwzzzQAQ/MentalGLM.

心理健康大模型可解释性中文NLP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。