用大模型打造私密化心理聊天机器人,提升可及性与个性化
Advancing Conversational Psychotherapy: Integrating Privacy, Dual-Memory, and Domain Expertise with Large Language Models
- 引入双记忆机制,结合短期对话与长期档案生成回应
- 隐私模块保障用户数据安全,双BERT模型评估效果优于普通LLM
- 适合关注心理健康、想低成本获得专业支持的人群
心理健康问题日益突出,传统心理治疗受限于地点、时间、成本和隐私担忧。为此,我们提出SoulSpeak,一个基于大语言模型(LLM)的心理聊天机器人,旨在提升心理服务的可及性。SoulSpeak通过检索增强生成(RAG)实现短时与长时记忆融合,构建双记忆组件,支持个性化回复;同时配备专用隐私模块,保护用户数据与情感隐私。系统基于治疗师-来访者对话数据集,结合多种提示技术对齐心理治疗方法。我们引入两个微调后的BERT模型:对话心理治疗偏好模型(CPPM)用于模拟人类对回复的偏好,另一模型评估回复与用户输入的相关性。实验验证了双记忆组件的有效性与隐私模块的鲁棒性。结果表明,该系统在兼顾专业性与隐私的前提下,为缓解当前心理服务的可及性与个性化缺口提供了可行方案。
原文摘要 · Abstract (English)
Mental health has increasingly become a global issue that reveals the limitations of traditional conversational psychotherapy, constrained by location, time, expense, and privacy concerns. In response to these challenges, we introduce SoulSpeak, a Large Language Model (LLM)-enabled chatbot designed to democratize access to psychotherapy. SoulSpeak improves upon the capabilities of standard LLM-enabled chatbots by incorporating a novel dual-memory component that combines short-term and long-term context via Retrieval Augmented Generation (RAG) to offer personalized responses while ensuring the preservation of user privacy and intimacy through a dedicated privacy module. In addition, it leverages a counseling chat dataset of therapist-client interactions and various prompting techniques to align the generated responses with psychotherapeutic methods. We introduce two fine-tuned BERT models to evaluate the system against existing LLMs and human therapists: the Conversational Psychotherapy Preference Model (CPPM) to simulate human preference among responses and another to assess response relevance to user input. CPPM is useful for training and evaluating psychotherapy-focused language models independent from SoulSpeak, helping with the constrained resources available for psychotherapy. Furthermore, the effectiveness of the dual-memory component and the robustness of the privacy module are also examined. Our findings highlight the potential and challenge of enhancing mental health care by offering an alternative that combines the expertise of traditional therapy with the advantages of LLMs, providing a promising way to address the accessibility and personalization gap in current mental health services.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。