arXiv:2601.20330cs.CLcs.LG2026-01ACL被引 1

用动态对战评估大模型心理咨询能力,避免评分漂移。

PsychePass: Calibrating LLM Therapeutic Competence via Trajectory-Anchored Tournaments

  • 以模拟咨询轨迹锚定互动过程,精准测试模型能力。
  • 采用瑞士轮对战生成稳定评分,结果与专家判断高度一致。
  • 可将对战轨迹转为奖励信号,用于强化学习提升模型。

尽管大语言模型在心理健康领域展现潜力,但其治疗能力的评估仍因咨询过程的非结构化和长期性而困难。现有评估方法存在无锚定缺陷,导致两种不稳定性:过程漂移(客户模拟偏离目标)和标准漂移(静态评分缺乏稳定性)。为此,我们提出 PsychePass 框架,通过轨迹锚定的对战机制校准大模型的治疗能力。首先在模拟中锚定交互轨迹,让客户精准控制咨询流程以探测多维度能力;其次在评判中锚定对战轨迹,采用高效的瑞士轮赛制,通过动态成对对抗生成稳健的 Elo 评分。实验表明,该框架不仅能可靠排序模型,还可将对战轨迹转化为可信奖励信号,支持在线策略强化学习以提升模型表现。大量实验证实 PsychePass 效果显著,且与人类专家判断高度一致。

原文摘要 · Abstract (English)

While large language models show promise in mental healthcare, evaluating their therapeutic competence remains challenging due to the unstructured and longitudinal nature of counseling. We argue that current evaluation paradigms suffer from an unanchored defect, leading to two forms of instability: process drift, where unsteered client simulation wanders away from specific counseling goals, and standard drift, where static pointwise scoring lacks the stability for reliable judgment. To address this, we introduce Ps, a unified framework that calibrates the therapeutic competence of LLMs via trajectory-anchored tournaments. We first anchor the interaction trajectory in simulation, where clients precisely control the fluid consultation process to probe multifaceted capabilities. We then anchor the battle trajectory in judgments through an efficient Swiss-system tournament, utilizing dynamic pairwise battles to yield robust Elo ratings. Beyond ranking, we demonstrate that tournament trajectories can be transformed into credible reward signals, enabling on-policy reinforcement learning to enhance LLMs' performance. Extensive experiments validate the effectiveness of PsychePass and its strong consistency with human expert judgments.

心理对话评估框架强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。