arXiv:2411.01049cs.HCcs.AI2024-11被引 9

用数字孪生模拟人类与AI协作中的信任发展,验证其有效性与适用性。

Exploratory Models of Human-AI Teams: Leveraging Human Digital Twins to Investigate Trust Development

  • 通过数字孪生构建人类行为模型,分析共情、认知与情绪对信任的影响。
  • 对比不同LLM生成的对话,验证其能否复现真实的人类信任动态。
  • 适用于研究人机协作中信任机制,尤其适合关注可信AI设计的研究者。

随着人机团队(HAT)研究的发展,计算方法也在不断演进。本文探讨了利用人类数字孪生(HDT)建模人类在人机协作中信任发展的三个核心问题。首先,通过因果分析团队通信数据,揭示共情、社会认知和情绪等要素对信任形成的作用,并讨论了可信度、个体差异与动态测量等必须被数字孪生复制的特征。其次,评估了自评、交互行为与合规型行为等三类信任度量指标的有效性,初步模拟比较了不同大语言模型生成的HDT沟通内容,分析其再现人类信任模式的能力。第三,提出实验设计,区分数字孪生的信任倾向与基于透明度和能力的AI代理信任机制,为未来研究提供可扩展框架。

原文摘要 · Abstract (English)

As human-agent teaming (HAT) research continues to grow, computational methods for modeling HAT behaviors and measuring HAT effectiveness also continue to develop. One rising method involves the use of human digital twins (HDT) to approximate human behaviors and socio-emotional-cognitive reactions to AI-driven agent team members. In this paper, we address three research questions relating to the use of digital twins for modeling trust in HATs. First, to address the question of how we can appropriately model and operationalize HAT trust through HDT HAT experiments, we conducted causal analytics of team communication data to understand the impact of empathy, socio-cognitive, and emotional constructs on trust formation. Additionally, we reflect on the current state of the HAT trust science to discuss characteristics of HAT trust that must be replicable by a HDT such as individual differences in trust tendencies, emergent trust patterns, and appropriate measurement of these characteristics over time. Second, to address the question of how valid measures of HDT trust are for approximating human trust in HATs, we discuss the properties of HDT trust: self-report measures, interaction-based measures, and compliance type behavioral measures. Additionally, we share results of preliminary simulations comparing different LLM models for generating HDT communications and analyze their ability to replicate human-like trust dynamics. Third, to address how HAT experimental manipulations will extend to human digital twin studies, we share experimental design focusing on propensity to trust for HDTs vs. transparency and competency-based trust for AI agents.

人机协作数字孪生信任建模LLM应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。