用大模型生成的语义摘要提升抑郁文本识别的可解释性
Interpretable Depression Detection from Social Media Text Using LLM-Derived Embeddings
- 用大模型摘要生成语义嵌入,替代传统特征提取
- 零样本大模型在二分类任务中表现强,但难分严重程度
- 基于摘要嵌入的监督模型更适合多类与分级诊断
社交媒体中抑郁语言的准确且可解释的检测有助于早期发现心理健康问题并及时干预。本文研究大语言模型(LLMs)与传统机器学习分类器在三类社交文本心理预测任务中的应用:二分类抑郁、抑郁严重程度分类,以及抑郁、创伤后应激障碍(PTSD)和焦虑的鉴别诊断。我们在多个公开社交媒体文本数据集上,通过五折交叉验证比较零样本大模型与基于传统文本嵌入、心理语言学特征及大模型生成心理摘要所衍生嵌入的监督分类器。结果表明,零样本大模型在二分类任务中表现出色且泛化能力强,但在细粒度严重程度预测上表现不佳;而基于大模型摘要嵌入训练的监督模型在多分类和序数分类任务中往往更准确且一致。这些发现揭示了当前大模型在心理健康预测中的优势与局限,提示将大模型作为语义解释工具而非端到端分类器,可能是构建更高效、可解释的心理健康评估系统的重要方向。
原文摘要 · Abstract (English)
Accurate and interpretable detection of depressive language in social media can support early identification of mental health conditions and inform timely interventions. In this paper, we investigate the use of large language models (LLMs) and traditional machine learning classifiers for three social media-based mental health prediction tasks: binary depression classification, depression severity classification, and differential diagnosis among depression, PTSD, and anxiety. We compare zero-shot LLMs with supervised classifiers trained on conventional text embeddings, psycholinguistic features, and embeddings derived from LLM-generated mental health summaries. Across multiple publicly available social media text datasets and five-fold cross-validation experiments, we find that zero-shot LLMs exhibit strong performance and generalization in binary depression classification, but struggle with fine-grained severity prediction. In contrast, supervised models trained on LLM summary embeddings often achieve more accurate and consistent performance, particularly for multi-class and ordinal classification tasks. These findings highlight both the strengths and limitations of current LLMs for mental health prediction and suggest that using LLMs as semantic interpreters, rather than solely as end-to-end classifiers, may provide a promising direction for building more effective and interpretable mental health assessment systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。