arXiv:2501.03064cs.CL2025-01被引 5

构建首个心理咨诉信任度数据集,量化治疗关系中的信任演化。

Trust Modeling in Counseling Conversations: A Benchmark Study

  • 定义信任为患者表达意愿的动态轨迹,通过文本互动建模。
  • 推出包含212段对话、7级可信度标注的MENTAL-TRUST数据集。
  • 提出TrustBench基准,评估主流模型在信任预测上的表现。

在心理健康咨询中,尽管已有大量对话建模研究,但大多忽视了患者与治疗师之间互动质量的核心问题——治疗关系中的信任。信任直接影响咨询效果,体现为患者逐步向治疗师开放表达的意愿。本文将信任定义为可通过咨询文本交互观察到的动态演变过程,并引入一种治疗师辅助指标来评估信任水平。为此,我们构建了全新的MENTAL-TRUST数据集,包含212段经过专家验证的咨询会话,每条标注了七级有序信任等级。将信任建模任务设定为有序分类,提出了新的基准TrustBench,涵盖一系列经典与前沿语言模型。通过多维度评估,系统分析了不同模型在信任预测上的表现,旨在揭示信任在治疗互动中的演化机制。

原文摘要 · Abstract (English)

In mental health counseling, a variety of earlier studies have focused on dialogue modeling. However, most of these studies give limited to no emphasis on the quality of interaction between a patient and a therapist. The therapeutic bond between a patient and a therapist directly correlates with effective mental health counseling. It involves developing the patient's trust on the therapist over the course of counseling. To assess the therapeutic bond in counseling, we introduce trust as a therapist-assistive metric. Our definition of trust involves patients' willingness and openness to express themselves and, consequently, receive better care. We conceptualize it as a dynamic trajectory observable through textual interactions during the counseling. To facilitate trust modeling, we present MENTAL-TRUST, a novel counseling dataset comprising manual annotation of 212 counseling sessions with first-of-its-kind seven expert-verified ordinal trust levels. We project our problem statement as an ordinal classification task for trust quantification and propose a new benchmark, TrustBench, comprising a suite of classical and state-of-the-art language models on MENTAL-TRUST. We evaluate the performance across a suite of metrics and lay out an exhaustive set of findings. Our study aims to unfold how trust evolves in therapeutic interactions.

心理对话信任建模数据集有序分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。