研究不同解释方式对贷款决策中用户信任与认知负荷的影响。
Exploring the Impact of Explainable AI and Cognitive Capabilities on Users' Decisions
- 对比四种解释风格:示例、特征、规则和反事实,评估其效果。
- 高置信度显著提升用户依赖度并降低认知负荷,反事实解释虽难懂但提升准确率。
- 用户更重视解释而非信息,但性格差异对决策无显著影响。
人工智能系统在决策中应用日益广泛,引发关于其应提供何种信息与解释的讨论。现有研究多聚焦特征解释,较少关注其他形式。个性特质如认知需求(NFC)会影响个体决策结果。本研究在贷款申请场景中,考察了提供预测、置信度和准确率等AI信息,以及示例、特征、规则和反事实四种解释风格对准确率、用户依赖度和认知负荷的影响,并比较低与高NFC个体在优先级选择(贷款属性、AI信息、解释)上的差异。结果显示,高置信度显著提高用户依赖度并降低认知负荷;特征解释未提升准确率;反事实解释理解度较低,但在正确预测时提升整体准确率,增强依赖度并降低认知负荷。无论高低NFC个体均将解释置于贷款属性之后,而将AI信息视为最不重要。两组在准确率与认知负荷上无显著差异,质疑了性格特质在人机协作决策中的作用。研究呼吁构建以用户为中心的个性化可解释界面,融合多样解释方式并探索更多用户特征以优化人机协同。
原文摘要 · Abstract (English)
Artificial Intelligence (AI) systems are increasingly used for decision-making across domains, raising debates over the information and explanations they should provide. Most research on Explainable AI (XAI) has focused on feature-based explanations, with less attention on alternative styles. Personality traits like the Need for Cognition (NFC) can also lead to different decision-making outcomes among low and high NFC individuals. We investigated how presenting AI information (prediction, confidence, and accuracy) and different explanation styles (example-based, feature-based, rule-based, and counterfactual) affect accuracy, reliance on AI, and cognitive load in a loan application scenario. We also examined low and high NFC individuals' differences in prioritizing XAI interface elements (loan attributes, AI information, and explanations), accuracy, and cognitive load. Our findings show that high AI confidence significantly increases reliance on AI while reducing cognitive load. Feature-based explanations did not enhance accuracy compared to other conditions. Although counterfactual explanations were less understandable, they enhanced overall accuracy, increasing reliance on AI and reducing cognitive load when AI predictions were correct. Both low and high NFC individuals prioritized explanations after loan attributes, leaving AI information as the least important. However, we found no significant differences between low and high NFC groups in accuracy or cognitive load, raising questions about the role of personality traits in AI-assisted decision-making. These findings highlight the need for user-centric personalization in XAI interfaces, incorporating diverse explanation styles and exploring multiple personality traits and other user characteristics to optimize human-AI collaboration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。