揭示用户对AI诊断信任如何被局限性说明影响
Exploring Trust Calibration in XAI - The Impact of Exposing Model Limitations to Lay Users

- 通过15个病例测试,对比不同引导方式对信任判断的影响
- 仅针对单个病例的局限性说明能有效校准信任,且短期经验无效
- 真实预测质量比实验设计更能解释信任差异,适合医疗AI评估者阅读
信任校准——使用户信任度与模型实际能力匹配——是可解释AI安全部署的关键,但常以脱离客观表现的全局信任评分来评估。本研究开展一项预注册、有激励的英国代表性在线实验(N=418),基于皮肤病变分类任务,分离期望设定与实际体验。参与者使用固定XAI面板(恶性度评分、可信度评分、显著性图)完成15个病例评估,系统操纵五种基于示例的信息和局限性披露的引导条件,并结合五组自然呈现预测质量差异的刺激包。信任校准定义为信任相关判断(TAIS与个案评分)与实际表现基准之间的偏差,采用分层混合效应模型分析。结果表明,仅对个案层面的局限性披露能可靠影响信任校准,短期经验未能实现逐步校准。此外,实际刺激包所含信息解释了比实验操纵更大的方差。然而,参与者难以区分个案感知信任、可信度与准确率估计。研究讨论了局限性沟通设计及校准度量在XAI评估中的意义。所有研究材料与数据均公开可用。
原文摘要 · Abstract (English)
Trust calibration -- aligning user trust judgment with model capability -- is crucial for safe deployment of explainable AI (XAI), yet is often evaluated via global trust ratings detached from objective performance evidence. We present a preregistered, incentivized between-subject online study (N=418 representative UK sample) on explainable skin-lesion classification that disentangles expectation-setting from experienced performance. Participants completed 15 case evaluations using a fixed XAI panel (malignancy score, reliability score, and saliency map). We systematically manipulated five experimental onboarding conditions varying example-based information and limitation disclosures with five stimulus packages naturally varying observed prediction quality. Calibration was operationalized as the deviation between trust-related judgments (TAIS and case-wise ratings) and objective performance benchmarks for the encountered cases, analysed with hierarchical mixed-effects models. Only limitation disclosure for case-wise measures reliably impacts trust calibration, and short-term experience did not yield progressive calibration. Further, the experienced package of stimuli explained substantially more variance than the experimental manipulation. However, participants were hard-pressed to differentiate between case-wise perceived trust, trustworthiness, and accuracy estimation. We discuss implications for designing limitation communication and for measuring and analysing calibration metrics in XAI evaluations. All study materials and data of this study are publicly available for replication and further academic use.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。