让AI根据情境切换互补或对齐模式,提升人机协作效果
Align When They Want, Complement When They Need! Human-Centered Ensembles for Adaptive Human-AI Collaboration
- 通过上下文判断切换互补或对齐模型,实现自适应协作
- 实验证明该方法显著优于单一模型,人机团队表现更优
- 适合需要高信任与高性能并重的决策场景
在人机决策中,传统策略常使AI在人类优势领域表现下降,削弱信任;而高度对齐的AI又可能固化人类错误行为。本文指出这一性能提升与信任建立之间的根本矛盾,并提出一种以人为中心的自适应AI集成系统:基于上下文线索,通过简洁且近似最优的理性路由机制,在互补模型与对齐模型间动态切换。理论分析证明其有效性及收益最大化的条件。在模拟与真实数据上的实验表明,使用该集成系统的决策者表现显著优于采用单一模型(无论优化个体性能还是人机整体性能)的情况。
原文摘要 · Abstract (English)
In human-AI decision making, designing AI that complements human expertise has been a natural strategy to enhance human-AI collaboration, yet it often comes at the cost of decreased AI performance in areas of human strengths. This can inadvertently erode human trust and cause them to ignore AI advice precisely when it is most needed. Conversely, an aligned AI fosters trust yet risks reinforcing suboptimal human behavior and lowering human-AI team performance. In this paper, we start by identifying this fundamental tension between performance-boosting (i.e., complementarity) and trust-building (i.e., alignment) as an inherent limitation of the traditional approach for training a single AI model to assist human decision making. To overcome this, we introduce a novel human-centered adaptive AI ensemble that strategically toggles between two specialist AI models - the aligned model and the complementary model - based on contextual cues, using an elegantly simple yet provably near-optimal Rational Routing Shortcut mechanism. Comprehensive theoretical analyses elucidate why the adaptive AI ensemble is effective and when it yields maximum benefits. Moreover, experiments on both simulated and real-world data show that when humans are assisted by the adaptive AI ensemble in decision making, they can achieve significantly higher performance than when they are assisted by single AI models that are trained to either optimize for their independent performance or even the human-AI team performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。