arXiv:2501.00982cs.CLcs.AI2025-01ACL被引 20

用标准化问卷引导大模型,让AI更懂心理评估。

Are LLMs effective psychological assessors? Leveraging adaptive RAG for interpretable mental health screening through psychometric practice

  • 用自适应检索增强生成技术,将社交媒体内容与临床问卷匹配
  • 在Reddit数据上完成抑郁量表,性能超越现有方法且无需训练数据
  • 结果可解释性强,适合医疗健康领域可信AI应用

在心理实践中,标准化量表是通过结构化、临床验证问题评估心理健康的重要工具。尽管社交媒体平台提供丰富数据用于心理健康筛查,但现有计算方法常绕过这些临床工具,采用黑箱分类。本文提出一种基于问卷引导的筛查框架,通过自适应检索增强生成(aRAG)连接非结构化社交媒体内容与标准化临床评估。该方法为每个量表条目检索相关帖子,并利用大语言模型(LLMs)完成经验证的心理量表。实验表明:1)在完成贝克抑郁量表Ⅱ(BDI-II)时,本方法在基于Reddit的基准上达到或超过当前最优性能,且无需训练数据;2)通过标准化量表引导大模型,比直接提示效果更优,同时输出可追溯至临床诊断标准,具备更高可解释性。此外,作为概念验证,该方法可扩展至其他心理障碍筛查,凸显大模型作为心理评估工具的潜力。

原文摘要 · Abstract (English)

In psychological practices, standardized questionnaires serve as essential tools for assessing mental health through structured, clinically-validated questions (i.e., items). While social media platforms offer rich data for mental health screening, computational approaches often bypass these established clinical assessment tools in favor of black-box classification. We propose a novel questionnaire-guided screening framework that bridges psychological practice and computational methods through adaptive Retrieval-Augmented Generation (\textit{aRAG}). Our approach links unstructured social media content and standardized clinical assessments by retrieving relevant posts for each questionnaire item and using Large Language Models (LLMs) to complete validated psychological instruments. Our findings demonstrate two key advantages of questionnaire-guided screening: First, when completing the Beck Depression Inventory-II (BDI-II), our approach matches or outperforms state-of-the-art performance on Reddit-based benchmarks without requiring training data. Second, we show that guiding LLMs through standardized questionnaires can yield superior results compared to directly prompting them for depression screening, while also providing a more interpretable assessment by linking model outputs to clinically validated diagnostic criteria. Additionally, we show, as a proof-of-concept, how our questionnaire-based methodology can be extended to other mental conditions' screening, highlighting the promising role of LLMs as psychological assessors.

心理评估大模型应用可解释AI问卷引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。