用面部表情增强心理治疗模型,更好应对患者抗拒。
MIRROR: Multimodal Cognitive Reframing Therapy for Rolling with Resistance
- 结合语音与面部表情,让AI理解患者情绪状态。
- 在有抗拒情境下,治疗联盟强度提升显著。
- 适合需要情感共情的智能心理咨询系统研究者。
近期研究探索了大语言模型在心理治疗中的应用,但基于文本的认知行为疗法模型常因无法应对患者抗拒而削弱治疗联盟。为此,我们提出一种多模态方法,引入非语言线索,使AI治疗师能更精准匹配患者的负面情绪状态。具体而言,我们构建了名为Mirror(多模态交互式抗拒滚动)的新合成数据集,该数据集将每个来访者的言语内容与对应的面部图像配对。利用该数据集,我们训练基础视觉-语言模型(VLMs),使其能分析面部线索、推断情绪,并生成具有同理心的回应,以有效管理患者抗拒。这些模型在治疗能力及面对抗拒时的治疗联盟强度方面进行了评估。结果表明,Mirror显著提升了AI治疗师应对抗拒的能力,优于现有纯文本CBT方法。人类专家评估进一步证实了该方法在管理抗拒和建立治疗联盟方面的有效性。
原文摘要 · Abstract (English)
Recent studies have explored the use of large language models (LLMs) in psychotherapy; however, text-based cognitive behavioral therapy (CBT) models often struggle with client resistance, which can weaken therapeutic alliance. To address this, we propose a multimodal approach that incorporates nonverbal cues, which allows the AI therapist to better align its responses with the client's negative emotional state. Specifically, we introduce a new synthetic dataset, Mirror (Multimodal Interactive Rolling with Resistance), which is a novel synthetic dataset that pairs each client's statements with corresponding facial images. Using this dataset, we train baseline vision language models (VLMs) so that they can analyze facial cues, infer emotions, and generate empathetic responses to effectively manage client resistance. These models are then evaluated in terms of both their counseling skills as a therapist, and the strength of therapeutic alliance in the presence of client resistance. Our results demonstrate that Mirror significantly enhances the AI therapist's ability to handle resistance, which outperforms existing text-based CBT approaches. Human expert evaluations further confirm the effectiveness of our approach in managing client resistance and fostering therapeutic alliance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。