arXiv:2606.17973cs.CL2026-06被引 1

用对话文本无感评估抑郁程度,准确率达80%以上。

Fine-tuning LLMs for Passive Depression Severity Estimation from AI Mental Health Dialogue

论文配图:Fine-tuning LLMs for Passive Depression Severity Estimation from AI Mental Health Dialogue
图 1 · 摘自论文原文
  • 用大模型细调,从用户与AI对话中预测抑郁评分
  • 测试集上平均误差仅2.6分,临床阈值判别准确率91%
  • 无需填问卷,适合长期心理状态监测场景

抑郁症是全球致残主因,早期识别症状变化对及时干预至关重要。现有量表如PHQ-9虽可规模化监测症状,但实际完成率低,导致响应偏差和系统性缺失。本文提出一种被动方法,仅通过用户与AI心理健康应用的对话文本,直接预测PHQ-9总分,无需额外临床数据。我们以Qwen3.5-27B为骨干网络,添加回归头,结合3,111个真实标签与由Claude Opus生成的伪标签,迭代训练中间模型,构建包含6,283名用户的联合数据集。在842名用户的保留测试集上,最优模型达到MAE=2.6、RMSE=4.0、Pearson r=0.80,且在PHQ-9≥10临床阈值下AUC达0.91。同时,在PHQ-9≥3至≥24的各个严重程度阈值下,AUC均超过0.87,表明模型能覆盖全临床谱系的抑郁程度。该研究为无需主动填报的AI心理平台持续症状监测提供了可行路径。

原文摘要 · Abstract (English)

Depression is the leading cause of disability worldwide, and early detection of symptom change is essential for timely intervention. Validated instruments such as the Patient Health Questionnaire-9 (PHQ-9) support symptom monitoring at scale, but real-world completion rates are low, introducing response bias and systematic missingness. Passive approaches that infer severity from routinely generated data could close this gap. We address this by predicting PHQ-9 total scores directly from transcripts of conversations between users and an AI mental health application, requiring only conversation text and no additional clinical data. We fine-tune a Qwen3.5-27B backbone with a regression head, augment 3,111 ground-truth labels with pseudolabels generated by a reasoning model (Claude Opus) and iteratively trained intermediate models, for a combined dataset of 6,283 users. On a held-out test set of 842 users, our best model achieves MAE = 2.6, RMSE = 4.0, Pearson r = 0.80, and AUC = 0.91 at the PHQ-9 >= 10 clinical threshold. We also find AUC > 0.87 at every severity threshold from PHQ-9 >= 3 to PHQ-9 >= 24, demonstrating that the model captures depression severity across the full clinical spectrum. This work opens the door to passive, continuous symptom monitoring in AI mental health platforms, without requiring users to complete self-report measures.

抑郁评估对话分析大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。