用合成数据提升大模型对焦虑抑郁的文本识别能力
Evaluating Large Language Models for Anxiety, Depression, and Stress Detection: Insights into Prompting Strategies and Synthetic Data
- 对比多种大模型与经典方法,用合成数据缓解标注不均衡
- 最佳模型在特定任务上F1达0.891,零样本合成策略效果接近有监督
- 适合做心理健康筛查系统的研发人员参考
全球超过五分之一成年人受心理健康问题困扰,但通过文本检测症状仍具挑战性,因表现形式微妙且多样。本研究评估了多种心理状态检测方法,对比了Llama、GPT等大语言模型与传统机器学习及基于Transformer的BERT、XLNet、Distil-RoBERTa等架构。基于临床访谈数据集DAIC-WOZ,对模型进行微调以实现焦虑、抑郁和压力分类,并采用合成数据生成缓解类别不平衡。结果显示,Distil-RoBERTa在GAD-2任务中达到最高F1(0.883),XLNet在PHQ任务中表现最优(F1高达0.891)。对于压力检测,零样本合成方法(SD+Zero-Shot-Basic)实现F1为0.884,ROC AUC为0.886。研究证明了基于Transformer模型的有效性,并强调合成数据在提升召回率与泛化能力方面的价值。但需谨慎校准,避免精度下降。整体表明,结合先进语言模型与数据增强可显著提升文本化心理状态自动评估能力。
原文摘要 · Abstract (English)
Mental health disorders affect over one-fifth of adults globally, yet detecting such conditions from text remains challenging due to the subtle and varied nature of symptom expression. This study evaluates multiple approaches for mental health detection, comparing Large Language Models (LLMs) such as Llama and GPT with classical machine learning and transformer-based architectures including BERT, XLNet, and Distil-RoBERTa. Using the DAIC-WOZ dataset of clinical interviews, we fine-tuned models for anxiety, depression, and stress classification and applied synthetic data generation to mitigate class imbalance. Results show that Distil-RoBERTa achieved the highest F1 score (0.883) for GAD-2, while XLNet outperformed others on PHQ tasks (F1 up to 0.891). For stress detection, a zero-shot synthetic approach (SD+Zero-Shot-Basic) reached an F1 of 0.884 and ROC AUC of 0.886. Findings demonstrate the effectiveness of transformer-based models and highlight the value of synthetic data in improving recall and generalization. However, careful calibration is required to prevent precision loss. Overall, this work emphasizes the potential of combining advanced language models and data augmentation to enhance automated mental health assessment from text.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。