机器人情感支持对话与人类治疗师相似度超九成,响应语义高度重合。
Do We Talk to Robots Like Therapists, and Do They Respond Accordingly? Language Alignment in AI Emotional Support
- 用嵌入聚类比对机器人与人类治疗对话主题结构
- 90.88%机器人发言可映射到人类治疗数据集主题簇
- 机器人与人类治疗师对相同问题的回应语义高度一致
随着对话代理越来越多地参与情感支持对话,理解其互动是否接近传统治疗场景至关重要。本研究分析了用户与专业治疗师(来自Hugging Face的NLP Mental Health Conversations数据集)的对话,以及与社交机器人QTrobot(基于GPT-3.5大语言模型)的对话。通过句子嵌入与K-means聚类,采用基于距离的簇匹配方法评估跨代理主题对齐性,并以欧氏距离验证。结果表明,90.88%的机器人对话内容可映射至人类治疗数据集的聚类中,显示共享的主题结构;在匹配簇中,使用Transformer、Word2Vec和BERT嵌入对比发现,双方用户披露主题及对相似问题的回应存在显著语义重叠。研究揭示了机器人支持对话的相似性与局限性,及其在心理健康干预中的潜在价值。
原文摘要 · Abstract (English)
As conversational agents increasingly engage in emotionally supportive dialogue, it is important to understand how closely their interactions resemble those in traditional therapy settings. This study investigates whether the concerns shared with a robot align with those shared in human-to-human (H2H) therapy sessions, and whether robot responses semantically mirror those of human therapists. We analyzed two datasets: one of interactions between users and professional therapists (Hugging Face's NLP Mental Health Conversations), and another involving supportive conversations with a social robot (QTrobot from LuxAI) powered by a large language model (LLM, GPT-3.5). Using sentence embeddings and K-means clustering, we assessed cross-agent thematic alignment by applying a distance-based cluster-fitting method that evaluates whether responses from one agent type map to clusters derived from the other, and validated it using Euclidean distances. Results showed that 90.88% of robot conversation disclosures could be mapped to clusters from the human therapy dataset, suggesting shared topical structure. For matched clusters, we compared the subjects as well as therapist and robot responses using Transformer, Word2Vec, and BERT embeddings, revealing strong semantic overlap in subjects' disclosures in both datasets, as well as in the responses given to similar human disclosure themes across agent types (robot vs. human therapist). These findings highlight both the parallels and boundaries of robot-led support conversations and their potential for augmenting mental health interventions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。