AI的自信会影响人的自我判断，且这种影响会持续存在。
As Confidence Aligns: Exploring the Effect of AI Confidence on Human Self-confidence in Human-AI Decision Making
- 通过随机实验发现用户自信心会随AI自信水平同步变化
- 即使AI退出，这种自信心对齐仍持续存在并影响判断校准
- 实时正确性反馈能减弱这种对齐效应，适合人机协作设计者参考
人类与AI协同决策依赖双方互补合作。实现这一目标的一种可行方法是考虑AI与用户经过校准的信心水平。然而，由于AI信心可能影响用户的自我信心及其校准，这一过程可能变得复杂。为探索这些动态，我们开展了一项随机行为实验。结果表明，在人机决策中，用户的自我信心会与AI信心对齐，且这种对齐在AI退出后仍持续存在，并影响用户自我信心的校准。此外，我们发现决策的实时正确性反馈可降低对齐程度。研究提示，用户自我信心并非独立于AI信心，从业者在追求更优人机协作时需关注这一现象。我们呼吁未来研究聚焦于人类认知与行为如何与AI保持一致。
原文摘要 · Abstract (English)
Complementary collaboration between humans and AI is essential for human-AI decision making. One feasible approach to achieving it involves accounting for the calibrated confidence levels of both AI and users. However, this process would likely be made more difficult by the fact that AI confidence may influence users' self-confidence and its calibration. To explore these dynamics, we conducted a randomized behavioral experiment. Our results indicate that in human-AI decision-making, users' self-confidence aligns with AI confidence and such alignment can persist even after AI ceases to be involved. This alignment then affects users' self-confidence calibration. We also found the presence of real-time correctness feedback of decisions reduced the degree of alignment. These findings suggest that users' self-confidence is not independent of AI confidence, which practitioners aiming to achieve better human-AI collaboration need to be aware of. We call for research focusing on the alignment of human cognition and behavior with AI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。