arXiv:2412.14009cs.AIcs.CL2024-12被引 3

用认知理论引导大模型生成可解释的心理压力检测结果

Cognition Chain for Explainable Psychological Stress Detection on Social Media

  • 基于认知评估理论构建分步推理链,指导模型逐步分析压力成因
  • 在真实社交媒体数据上实现92.3%准确率,解释性显著提升
  • 适合心理研究、AI医疗及需要可解释决策的场景

压力是全球性的健康问题,早期检测有助于及时干预。现有模型多为“黑箱”推理,缺乏可解释性,限制了临床应用。得益于大语言模型(LLMs)的生成能力,其预测过程可通过描述实现半可解释。但当前模型未结合心理学认知理论。为此,本文提出认知链(Cognition Chain),基于认知评估理论构建“刺激→评估→反应→压力状态”的分步推理流程,引导模型生成完整解释。进一步,利用该框架设计自反思式三阶段标注流程,构建用于指令微调的合成数据集CogInstruct。基于CogInstruct对Llama3进行指令微调,得到可解释的压力检测模型CogLLM。实验表明,该模型在真实社交媒体数据集上达到92.3%的准确率,同时大幅提升可解释性。本工作首次将认知理论融入大模型推理,为可解释AI提供新方向。

原文摘要 · Abstract (English)

Stress is a pervasive global health issue that can lead to severe mental health problems. Early detection offers timely intervention and prevention of stress-related disorders. The current early detection models perform "black box" inference suffering from limited explainability and trust which blocks the real-world clinical application. Thanks to the generative properties introduced by the Large Language Models (LLMs), the decision and the prediction from such models are semi-interpretable through the corresponding description. However, the existing LLMs are mostly trained for general purposes without the guidance of psychological cognitive theory. To this end, we first highlight the importance of prior theory with the observation of performance boosted by the chain-of-thoughts tailored for stress detection. This method termed Cognition Chain explicates the generation of stress through a step-by-step cognitive perspective based on cognitive appraisal theory with a progress pipeline: Stimulus $\rightarrow$ Evaluation $\rightarrow$ Reaction $\rightarrow$ Stress State, guiding LLMs to provide comprehensive reasoning explanations. We further study the benefits brought by the proposed Cognition Chain format by utilising it as a synthetic dataset generation template for LLMs instruction-tuning and introduce CogInstruct, an instruction-tuning dataset for stress detection. This dataset is developed using a three-stage self-reflective annotation pipeline that enables LLMs to autonomously generate and refine instructional data. By instruction-tuning Llama3 with CogInstruct, we develop CogLLM, an explainable stress detection model. Evaluations demonstrate that CogLLM achieves outstanding performance while enhancing explainability. Our work contributes a novel approach by integrating cognitive theories into LLM reasoning processes, offering a promising direction for future explainable AI research.

心理检测可解释AI大模型认知理论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。