用对话轨迹建模模拟真实心理咨询场景,提升训练与评估效果
PsyCLIENT: Client Simulation via Conversational Trajectory Modeling for Trainee Practice and Model Evaluation in Mental Health Counseling
- 基于真实对话轨迹生成客户行为,实现多样且逼真的模拟
- 中文模拟客户95%专家辨识率,接近真人水平
- 开源首个中文咨询角色数据集,适合心理教育研究者
基于大语言模型的客户模拟已成为训练新手咨询师和评估自动咨询系统的重要工具。然而,现有方法存在三大挑战:(1)客户画像多样性与真实性不足;(2)缺乏建模真实客户行为的系统框架;(3)中文语境下数据稀缺。为此,我们提出PsyCLIENT,一种基于对话轨迹建模的新型模拟框架。通过将大模型生成过程约束于包含显式行为标签与内容限制的真实轨迹,确保交互的多样性和现实性。我们进一步推出了首个开源中文客户画像数据集PsyCLIENT-CP,覆盖60个不同咨询主题。多位持证专业咨询师的综合评估表明,PsyCLIENT在真实感与训练有效性上显著优于基线方法。值得注意的是,模拟客户在专家辨识任务中达到约95%的混淆率,几乎无法与真人区分。结果表明,对话轨迹建模有效弥合理论画像与动态仿真之间的差距,为心理健康教育与研究提供可靠解决方案。代码与数据将公开,以推动该领域未来发展。
原文摘要 · Abstract (English)
LLM-based client simulation has emerged as a promising tool for training novice counselors and evaluating automated counseling systems. However, existing client simulation approaches face three key challenges: (1) limited diversity and realism in client profiles, (2) the lack of a principled framework for modeling realistic client behaviors, and (3) a scarcity in Chinese-language settings. To address these limitations, we propose PsyCLIENT, a novel simulation framework grounded in conversational trajectory modeling. By conditioning LLM generation on predefined real-world trajectories that incorporate explicit behavior labels and content constraints, our approach ensures diverse and realistic interactions. We further introduce PsyCLIENT-CP, the first open-source Chinese client profile dataset, covering 60 distinct counseling topics. Comprehensive evaluations involving licensed professional counselors demonstrate that PsyCLIENT significantly outperforms baselines in terms of authenticity and training effectiveness. Notably, the simulated clients are nearly indistinguishable from human clients, achieving an about 95\% expert confusion rate in discrimination tasks. These findings indicate that conversational trajectory modeling effectively bridges the gap between theoretical client profiles and dynamic, realistic simulations, offering a robust solution for mental health education and research. Code and data will be released to facilitate future research in mental health counseling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。