AI越大越强?人类误判会反而拖垮协作效率。
The Scaling Paradox in Human-AI Collaboration
- 构建模型分析人机协作中AI规模与绩效关系
- 高估AI能力会导致系统性能下降,反而亏钱
- 企业需调整策略管理认知偏差,而非盲目扩规模
Scaling laws揭示了AI系统随规模增长能力可预测提升的规律。然而在真实场景中,AI常与人类协同工作,其效能是否仍能延续存疑。本文建立分析模型,发现只有当人类对AI能力有准确认知时,人机系统性能才随AI规模正向提升。若人类高估AI能力,会出现“规模悖论”:更强大的AI反而降低整体性能并加剧企业利润损失;若低估,则性能虽提升但增速显著放缓。研究进一步表明,企业可通过成本内化、认知对齐等运营策略缓解认知偏差,效果取决于部署经济特性与偏差方向。结论提示:组织应更重视人机界面管理,而非单纯追求更大更贵的AI系统。最终,AI规模化能否创造价值,关键在于其能力如何影响人类认知与协作行为。
原文摘要 · Abstract (English)
The discovery of scaling laws has highlighted the extraordinary potential of AI systems with a striking empirical pattern: as AI systems scale, their capabilities tend to improve predictably. Yet, in real-world applications, AI rarely operates in isolation; instead, it often works alongside humans, raising the question of whether these gains persist in human-AI collaboration. In this work, we develop an analytical model to examine when the empirical scaling benefits of AI translate into improved human-AI joint system performance. We demonstrate that the performance of a human-AI system can scale positively as the AI scales up-provided that humans have an accurate perception of the AI's capabilities. Human misperception, however, can fundamentally alter this relationship: i) when humans over-perceive the AI's capabilities, a scaling paradox may arise, in which greater AI scale reduces overall system performance and amplifies firm-level profit losses, and (ii) when humans under-perceive the AI's capabilities, performance still improves with scale but at a substantially slower rate. We further show that firms can actively manage these distortions through operational policies such as cost internalization and perception alignment, whose effectiveness depends on the economics of AI deployment and the direction of human misperception. These findings suggest that organizations may benefit more from managing the human-AI interface than from simply investing in larger, more expensive AI systems. More broadly, our results suggest that AI scaling should be viewed not only as a technological challenge, but also as a behavioral and operational one, and caution against the view that larger AI systems will automatically lead to better operational outcomes. Whether AI scaling creates value ultimately depends on how increased AI capabilities shape human beliefs and collaborative efforts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。