arXiv:2505.14377cs.HCcs.AI2025-05中稿 · XAI2025被引 3

AI偏见会悄悄影响人决策,反事实解释能逆转这种影响。

When Bias Backfires: The Modulatory Role of Counterfactual Explanations on the Adoption of Algorithmic Bias in XAI-Supported Human Decision-Making

  • 用模拟招聘实验测试带偏见的AI如何影响人类判断
  • 70%的人跟从AI推荐,但仅8人察觉性别偏见
  • 提供反事实解释可让决策反转偏见,适合政策制定者参考

尽管人工智能提升效率与客观性,却可能将偏见传递给人类决策。本研究通过模拟招聘场景开展控制实验,考察带有或不带反事实解释的有偏AI推荐对人类判断的影响。参与者作为招聘经理完成60次决策,分为无AI、有偏AI(倾向男性或女性候选人)、后交互三个阶段。结果显示,当候选人条件相近时,参与者遵循AI建议的比例达70%;但仅有8人察觉性别偏见。关键发现:未获反事实解释时,后期独立决策仍延续偏见;而事先提供解释则使决策反转偏见。信任度在各条件下无显著差异,但面对男性偏见后,信心水平随阶段变化,显示偏见对决策确定性的微妙影响。研究强调需校准可解释AI,防止无意中固化算法偏见,保障公平决策。

原文摘要 · Abstract (English)

Although the integration of artificial intelligence (AI) into everyday tasks improves efficiency and objectivity, it also risks transmitting bias to human decision-making. In this study, we conducted a controlled experiment that simulated hiring decisions to examine how biased AI recommendations - augmented with or without counterfactual explanations - influence human judgment over time. Participants, acting as hiring managers, completed 60 decision trials divided into a baseline phase without AI, followed by a phase with biased (X)AI recommendations (favoring either male or female candidates), and a final post-interaction phase without AI. Our results indicate that the participants followed the AI recommendations 70% of the time when the qualifications of the given candidates were comparable. Yet, only a fraction of participants detected the gender bias (8 out of 294). Crucially, exposure to biased AI altered participants' inherent preferences: in the post-interaction phase, participants' independent decisions aligned with the bias when no counterfactual explanations were provided before, but reversed the bias when explanations were given. Reported trust did not differ significantly across conditions. Confidence varied throughout the study phases after exposure to male-biased AI, indicating nuanced effects of AI bias on decision certainty. Our findings point to the importance of calibrating XAI to avoid unintended behavioral shifts in order to safeguard equitable decision-making and prevent the adoption of algorithmic bias.

可解释AI算法偏见决策行为

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。