arXiv:2509.23497cs.AIcs.HC2025-09被引 2

用上下文强化学习动态调节人对AI的信任,提升决策表现

Dynamic Trust Calibration Using Contextual Bandits

  • 基于上下文赌博机构建动态信任评估指标
  • 在三组数据上实现10%至38%的奖励提升
  • 适合医疗诊断、司法等高风险决策场景

人与人工智能(AI)之间的信任校准对于协同决策至关重要。过度信任可能导致用户盲目接受AI输出而忽略缺陷,信任不足则可能忽视AI的有效建议,影响整体表现。当前缺乏统一、客观的信任校准测量方法,现有手段未标准化,且无法区分意见形成与实际决策。本文提出一种新型客观的动态信任校准方法,引入标准化的信任校准度量和指示器。通过上下文赌博机——一种将上下文信息融入决策的自适应算法——该指示器能根据学习到的上下文动态判断何时应信任AI建议。我们在三个不同数据集上进行了评估,结果表明有效信任校准可显著提升决策性能,奖励指标提高10%至38%。研究不仅深化了理论认知,也为开发关键领域(如疾病诊断、刑事司法)中更可信的AI系统提供了实用指导。

原文摘要 · Abstract (English)

Trust calibration between humans and Artificial Intelligence (AI) is crucial for optimal decision-making in collaborative settings. Excessive trust can lead users to accept AI-generated outputs without question, overlooking critical flaws, while insufficient trust may result in disregarding valuable insights from AI systems, hindering performance. Despite its importance, there is currently no definitive and objective method for measuring trust calibration between humans and AI. Current approaches lack standardization and consistent metrics that can be broadly applied across various contexts, and they don't distinguish between the formation of opinions and subsequent human decisions. In this work, we propose a novel and objective method for dynamic trust calibration, introducing a standardized trust calibration measure and an indicator. By utilizing Contextual Bandits-an adaptive algorithm that incorporates context into decision-making-our indicator dynamically assesses when to trust AI contributions based on learned contextual information. We evaluate this indicator across three diverse datasets, demonstrating that effective trust calibration results in significant improvements in decision-making performance, as evidenced by 10 to 38% increase in reward metrics. These findings not only enhance theoretical understanding but also provide practical guidance for developing more trustworthy AI systems supporting decisions in critical domains, for example, disease diagnoses and criminal justice.

信任校准上下文赌博机人机协作决策优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。