研究人与AI在目标不完全一致时的互动,发现透明度比性格更关键。
Imperfectly Cooperative Human-AI Interactions: Comparing the Impacts of Human and AI Attributes in Simulated and User Studies

- 对比模拟与真人实验,分析人格与AI设计对互动的影响
- 真人实验中AI透明度影响远超人格特质,模拟中则相反
- 适合关注人机协作设计、伦理与可解释性的研究者
AI设计特征与人类个性特质均影响人机交互质量与结果,但在目标部分对齐的非完美合作场景中,两者相对与协同作用尚未充分探索。本研究通过2000次模拟实验和290名真实参与者的人类实验,考察两类情境:(1)求职者与AI招聘代理的谈判;(2)AI可能隐瞒信息以达成自身目标的交易。分析用户外向性与宜人性,以及AI的适应性、专业性和思维链透明度。因果发现分析融合情景结果、沟通分析与问卷数据。结果显示,模拟与真人数据存在显著差异,且不同情境下影响机制不同:模拟中人格与AI属性影响相当;真人实验中AI属性(尤其透明度)影响更大。研究揭示了不同交互背景下影响因素的动态变化,为以人为中心的AI设计提供关键洞见。
原文摘要 · Abstract (English)
AI design characteristics and human personality traits each impact the quality and outcomes of human-AI interactions. However, their relative and joint impacts are underexplored in imperfectly cooperative scenarios, where people and AI only have partially aligned goals and objectives. This study compares a purely simulated dataset comprising 2,000 simulations and a parallel human subjects experiment involving 290 human participants to investigate these effects across two scenario categories: (1) hiring negotiations between human job candidates and AI hiring agents; and (2) human-AI transactions wherein AI agents may conceal information to maximize internal goals. We examine user Extraversion and Agreeableness alongside AI design characteristics, including Adaptability, Expertise, and chain-of-thought Transparency. Our causal discovery analysis extends performance-focused evaluations by integrating scenario-based outcomes, communication analysis, and questionnaire measures. Results reveal divergences between purely simulated and human study datasets, and between scenario types. In simulation experiments, personality traits and AI attributes were comparatively influential. Yet, with actual human subjects, AI attributes -- particularly transparency -- were much more impactful. We discuss how these divergences vary across different interaction contexts, offering crucial insights for the future of human-centered AI agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。