对比真实与大模型生成的心理咨询对话,发现前者情感更丰富真实。
Feel the Difference? A Comparative Analysis of Emotional Arcs in Real and LLM-Generated CBT Sessions
- 用细粒度情绪动态框架分析对话中情绪变化
- 真实对话情绪波动更大,语言更带情绪,调节更自然
- 适合关注心理AI数据真实性的研究者
大语言模型生成的合成心理咨询对话被广泛用于心理健康自然语言处理,但其是否捕捉真实对话中细腻的情绪动态仍不明确。本文提出真实认知行为疗法(RealCBT)数据集,并首次对比分析真实与合成对话的情绪弧线。采用话语情绪动态框架,从愉悦度、唤醒度和支配度三个维度分析完整对话及咨询师与来访者角色的情绪轨迹。基于RealCBT真实数据与CACTUS合成数据的对比发现:尽管合成对话流畅且结构完整,但在关键情绪属性上与真实对话存在显著差异——真实对话表现出更高情绪波动性、更丰富的情绪化语言以及更真实的反应与调节模式。所有配对间情绪弧相似度均较低,尤其在真实与合成角色之间对齐极弱。结果表明当前大模型生成的心理咨询数据存在情感失真问题,强调了情感保真度在心理健康应用中的重要性。为支持后续研究,RealCBT数据集已公开于https://gitlab.com/xiaoyi.wang/realcbt-dataset。
原文摘要 · Abstract (English)
Synthetic therapy dialogues generated by large language models (LLMs) are increasingly used in mental health NLP to simulate counseling scenarios, train models, and supplement limited real-world data. However, it remains unclear whether these synthetic conversations capture the nuanced emotional dynamics of real therapy. In this work, we introduce RealCBT, a dataset of authentic cognitive behavioral therapy (CBT) dialogues, and conduct the first comparative analysis of emotional arcs between real and LLM-generated CBT sessions. We adapt the Utterance Emotion Dynamics framework to analyze fine-grained affective trajectories across valence, arousal, and dominance dimensions. Our analysis spans both full dialogues and individual speaker roles (counselor and client), using real sessions from the RealCBT dataset and synthetic dialogues from the CACTUS dataset. We find that while synthetic dialogues are fluent and structurally coherent, they diverge from real conversations in key emotional properties: real sessions exhibit greater emotional variability, more emotion-laden language, and more authentic patterns of reactivity and regulation. Moreover, emotional arc similarity remains low across all pairings, with especially weak alignment between real and synthetic speakers. These findings underscore the limitations of current LLM-generated therapy data and highlight the importance of emotional fidelity in mental health applications. To support future research, our dataset RealCBT is released at https://gitlab.com/xiaoyi.wang/realcbt-dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。