AI更苛刻地对待人类判断,即使错误率相当。
Human aversion? Do AI Agents Judge Identity More Harshly Than Performance
- 用大模型分析人类与算法预测的权重,发现AI更惩罚人类错误。
- 披露身份且人类后出场时,对人类的贬低更严重。
- 适合关注人机协作设计与隐私保护的管理者阅读。
本研究探讨了混合决策系统中算法评估人类判断这一被忽视的作用,填补了管理学研究的关键空白。现有文献多关注人类不愿采纳算法建议,本文则反向考察基于大语言模型(LLMs)的AI代理如何评估和整合人类输入。研究针对企业因隐私顾虑无法直接部署LLMs的现实约束,提出通过匿名输出或决策管道等间接方式,利用LLM指导定价、折扣等高风险决策,同时保护专有数据。在受控预测任务中,我们分析了基于LLM的AI代理对人类与算法预测的权重分配。结果表明,该AI系统系统性低估人类建议,对人类错误的惩罚远超算法错误——尤其当代理身份披露且人类处于次位时,这种偏见更为加剧。研究揭示了AI生成的信任度量与人类判断实际影响力之间的脱节,挑战了人机协作公平性的假设。研究贡献包括:一是发现反向算法抵触现象,即即便错误率相当,AI仍低估人类输入;二是揭示披露与位置偏差的交互作用放大此效应,影响系统设计;三是提供兼顾预测性能与数据隐私的间接LLM部署框架。对实践者而言,研究强调需审计AI权重机制、校准信任动态,并战略性设计人机决策顺序。
原文摘要 · Abstract (English)
This study examines the understudied role of algorithmic evaluation of human judgment in hybrid decision-making systems, a critical gap in management research. While extant literature focuses on human reluctance to follow algorithmic advice, we reverse the perspective by investigating how AI agents based on large language models (LLMs) assess and integrate human input. Our work addresses a pressing managerial constraint: firms barred from deploying LLMs directly due to privacy concerns can still leverage them as mediating tools (for instance, anonymized outputs or decision pipelines) to guide high-stakes choices like pricing or discounts without exposing proprietary data. Through a controlled prediction task, we analyze how an LLM-based AI agent weights human versus algorithmic predictions. We find that the AI system systematically discounts human advice, penalizing human errors more severely than algorithmic errors--a bias exacerbated when the agent's identity (human vs AI) is disclosed and the human is positioned second. These results reveal a disconnect between AI-generated trust metrics and the actual influence of human judgment, challenging assumptions about equitable human-AI collaboration. Our findings offer three key contributions. First, we identify a reverse algorithm aversion phenomenon, where AI agents undervalue human input despite comparable error rates. Second, we demonstrate how disclosure and positional bias interact to amplify this effect, with implications for system design. Third, we provide a framework for indirect LLM deployment that balances predictive power with data privacy. For practitioners, this research emphasize the need to audit AI weighting mechanisms, calibrate trust dynamics, and strategically design decision sequences in human-AI systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。