arXiv:2509.16437cs.HCcs.AI2025-09被引 10

构建用户感知共情的分类体系与真实对话数据集,揭示共情评价的高度个性化特征。

SENSE-7: Taxonomy and Dataset for Measuring User Perceptions of Empathy in Sustained Human-AI Conversations

  • 基于用户真实反馈构建可观察共情行为分类体系
  • 分析695次对话发现共情判断受情境和连续性影响显著
  • 提供672条匿名对话数据,支持共情等级自动识别研究

共情在人机交互中日益重要,但现有数字共情研究多聚焦模拟人类内在情绪状态,忽视用户感知中主观、情境化和关系性的共情本质。本文提出以人为中心的共情行为分类体系,构建真实职场人员与大语言模型对话的数据集Sense-7,包含每轮对话的用户共情标注、用户特征与上下文信息,实现更贴近用户的共情表征。对109名参与者695次对话的分析表明,共情判断高度个体化、情境敏感,当对话连贯性中断或用户预期未被满足时易受干扰。我们提供672条匿名对话子集,并进行探索性分类分析,结果显示基于LLM的分类器可识别5个共情等级,平均斯皮尔曼相关系数ρ=0.369,准确率0.487。研究强调需设计能动态适配用户情境与目标的共情行为,为社会感知型智能代理的发展提供路径。

原文摘要 · Abstract (English)

Empathy is increasingly recognized as a key factor in human-AI communication, yet conventional approaches to "digital empathy" often focus on simulating internal, human-like emotional states while overlooking the inherently subjective, contextual, and relational facets of empathy as perceived by users. In this work, we propose a human-centered taxonomy that emphasizes observable empathic behaviors and introduce a new dataset, Sense-7, of real-world conversations between information workers and Large Language Models (LLMs), which includes per-turn empathy annotations directly from the users, along with user characteristics, and contextual details, offering a more user-grounded representation of empathy. Analysis of 695 conversations from 109 participants reveals that empathy judgments are highly individualized, context-sensitive, and vulnerable to disruption when conversational continuity fails or user expectations go unmet. To promote further research, we provide a subset of 672 anonymized conversation and provide exploratory classification analysis, showing that an LLM-based classifier can recognize 5 levels of empathy with an encouraging average Spearman $ρ$=0.369 and Accuracy=0.487 over this set. Overall, our findings underscore the need for AI designs that dynamically tailor empathic behaviors to user contexts and goals, offering a roadmap for future research and practical development of socially attuned, human-centered artificial agents.

人机共情对话数据集用户感知大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。