arXiv:2411.19229cs.HCcs.AI2024-11中稿 · Italian Workshop o…被引 5

用RAG技术打造个性化行为改变聊天机器人,无需重训模型

Habit Coach: Customising RAG-based chatbots to support behavior change

  • 通过检索增强生成实现不重训模型的个性化交互
  • 五天干预后用户习惯强度显著下降(SRHI测量)
  • 从陈述性知识转向过程性知识提升治疗对话效果

本文介绍了基于GPT的聊天机器人Habit Coach的迭代开发过程,旨在通过个性化交互支持用户行为改变。系统采用检索增强生成(RAG)架构,在不重新训练底层语言模型(GPT-4)的前提下,利用文档检索与定制提示实现行为个性化,结合认知行为疗法(CBT)与叙事治疗技术。初期仅提供教科书式陈述性知识和高层对话目标,导致交互不精准、效率低,因GPT难以将静态知识转化为动态情境回应。经过四轮迭代,逐步引入过程性知识,优化交互策略,提升整体有效性。最终评估中,5名参与者连续5天使用该系统,接受个性化CBT干预。通过自我报告习惯指数(SRHI)测量,干预后习惯强度显著降低。结果表明,在RAG系统中,过程性知识对实现有效个性化行为支持至关重要。

原文摘要 · Abstract (English)

This paper presents the iterative development of Habit Coach, a GPT-based chatbot designed to support users in habit change through personalized interaction. Employing a user-centered design approach, we developed the chatbot using a Retrieval-Augmented Generation (RAG) system, which enables behavior personalization without retraining the underlying language model (GPT-4). The system leverages document retrieval and specialized prompts to tailor interactions, drawing from Cognitive Behavioral Therapy (CBT) and narrative therapy techniques. A key challenge in the development process was the difficulty of translating declarative knowledge into effective interaction behaviors. In the initial phase, the chatbot was provided with declarative knowledge about CBT via reference textbooks and high-level conversational goals. However, this approach resulted in imprecise and inefficient behavior, as the GPT model struggled to convert static information into dynamic and contextually appropriate interactions. This highlighted the limitations of relying solely on declarative knowledge to guide chatbot behavior, particularly in nuanced, therapeutic conversations. Over four iterations, we addressed this issue by gradually transitioning towards procedural knowledge, refining the chatbot's interaction strategies, and improving its overall effectiveness. In the final evaluation, 5 participants engaged with the chatbot over five consecutive days, receiving individualized CBT interventions. The Self-Report Habit Index (SRHI) was used to measure habit strength before and after the intervention, revealing a reduction in habit strength post-intervention. These results underscore the importance of procedural knowledge in driving effective, personalized behavior change support in RAG-based systems.

行为改变RAG心理支持聊天机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。