arXiv:2411.06723cs.HCcs.AI2024-11被引 19

用专家脚本与治疗策略对齐大模型,提升心理聊天机器人的共情与专业性。

Script-Strategy Aligned Generation: Aligning LLMs with Expert-Crafted Dialogue Scripts and Therapeutic Strategies for Psychotherapy

  • 通过微调和提示工程,让大模型对齐专家设计的对话脚本与治疗策略。
  • 对齐后的模型在共情、相关性和治疗原则遵循上显著优于规则型和纯大模型。
  • 新方法仅需不足40%的专家脚本内容,适合希望高效协作的心理健康应用开发。

聊天机器人或对话代理(CAs)正被广泛用于提升数字心理治疗的可及性。现有系统多依赖僵化的规则设计,严重依赖专家编写的对话脚本引导治疗对话。尽管大语言模型(LLMs)为更灵活的交互提供了可能,但其可控性与可解释性不足,在高风险的心理治疗场景中构成挑战。本文通过两项研究探索将大模型与专家脚本对齐以提升表现:研究1(N=43)采用被试内设计,比较规则型、纯大模型及经专家脚本微调与提示对齐的大模型。结果表明,对齐的LLM在共情、对话相关性和治疗原则遵循方面显著更优。基于此,提出“脚本-策略对齐生成(SSAG)”方法,降低对完整脚本的依赖,同时保持治疗一致性与可控性。研究2(10天实地实验,N=21)显示,SSAG在疗效上媲美全脚本大模型,但所需专家脚本内容不足40%。该工作推动了大模型在心理治疗中的应用,提供可控制、可扩展的解决方案,使领域专家可通过高层策略而非完整脚本对齐模型,实现更高效的协同开发,扩大心理治疗的应用范围。

原文摘要 · Abstract (English)

Chatbots or conversational agents (CAs) are increasingly used to improve access to digital psychotherapy. Many current systems rely on rigid, rule-based designs, heavily dependent on expert-crafted dialogue scripts for guiding therapeutic conversations. Although advances in large language models (LLMs) offer potential for more flexible interactions, their lack of controllability and explanability poses challenges in high-stakes contexts like psychotherapy. To address this, we conducted two studies in this work to explore how aligning LLMs with expert-crafted scripts can enhance psychotherapeutic chatbot performance. In Study 1 (N=43), an online experiment with a within-subjects design, we compared rule-based, pure LLM, and LLMs aligned with expert-crafted scripts via fine-tuning and prompting. Results showed that aligned LLMs significantly outperformed the other types of chatbots in empathy, dialogue relevance, and adherence to therapeutic principles. Building on findings, we proposed ``Script-Strategy Aligned Generation (SSAG)'', a more flexible alignment approach that reduces reliance on fully scripted content while maintaining LLMs' therapeutic adherence and controllability. In a 10-day field Study 2 (N=21), SSAG achieved comparable therapeutic effectiveness to full-scripted LLMs while requiring less than 40\% of expert-crafted dialogue content. Beyond these results, this work advances LLM applications in psychotherapy by providing a controllable and scalable solution, reducing reliance on expert effort. By enabling domain experts to align LLMs through high-level strategies rather than full scripts, SSAG supports more efficient co-development and expands access to a broader context of psychotherapy.

心理治疗大模型对齐对话系统医疗AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。