arXiv:2605.16041stat.MLcs.LG2026-05

让算法决策可申诉:提出可争议性新框架,超越解释性AI。

Explainable AI Isn't Enough! Rethinking Algorithmic Contestability

论文配图:Explainable AI Isn't Enough! Rethinking Algorithmic Contestability
图 1 · 摘自论文原文
  • 定义算法可争议性:假设决策可能错误,寻找推翻依据。
  • 发现传统XAI仅能揭示局部误差,无法推翻现有决策。
  • 提出三类可争议证据:预测多样性、特征值错误、被忽略的反证。

机器学习系统在贷款审批、招聘、作弊检测等关乎个人命运的决策中日益普及,引发关键问题:个体如何回应这些不透明系统做出的负面决定?尽管可解释人工智能(XAI)主要关注算法补救——帮助个体改变自身特征以获得理想结果——但与之并行的算法可争议性——即帮助个体审查并纠正错误决策——却未受足够重视,尽管其具有重要的伦理和法律意义。我们追溯这一忽视源于缺乏对可争议性的清晰形式定义与系统化操作。为此,我们提出可争议性的操作定义,作为补救的自然补充:可争议性以决策可能错误为前提,聚焦于识别可推翻该决策的证据;而补救则假设决策正确,仅提供改变路径。我们证明,标准的XAI解释(如反事实、LIME、Anchors),即使结合人类对决策连续性或单调性的直觉,也仅揭示个体邻域内的误差,不足以推翻当前决策。因此,我们超越传统XAI,识别出三类根据决策者自身伦理标准应导致决策撤销的证据:预测多样性、错误特征值、被忽略的压倒性证据。我们认为这些使决策在规范上无法成立,因而具备可争议性。最后,我们分析现有欧盟立法如何与本框架衔接,主张个体已拥有获取此类证据的法定权利。

原文摘要 · Abstract (English)

Machine learning systems increasingly make life-changing decisions about individuals, such as loan approvals, hiring, and cheating detection, raising a pressing question: how can individuals respond to negative decisions made by these opaque systems? While explainable artificial intelligence (XAI) has largely focused on algorithmic recourse -- helping individuals change their features to obtain a desired outcome -- the parallel problem of algorithmic contestability -- helping individuals review and correct erroneous algorithmic decisions -- has received far less attention, despite its central ethical and legal importance. We trace this neglect to the absence of clear formal definitions and a systematic operationalization of contestability as an algorithmic problem. To address it, we propose an operational definition of contestability as a natural complement to recourse: contestability starts from the presumption that a decision may be incorrect and focuses on identifying evidence to challenge and potentially overturn it, whereas recourse assumes the decision is valid and instead provides pathways for changing it. We show that standard XAI explanations, such as counterfactuals, LIME, or Anchors, even when combined with human intuitions about decision continuity or monotonicity, reveal only errors in the neighborhood of the individual, but provide insufficient grounds for overturning the decision at hand. Going thus beyond traditional XAI, we identify three types of evidence warranting reversal according to the decision maker's own ethical standards: predictive multiplicity, incorrect feature values, and neglected overruling evidence. We argue that these render decisions normatively indefensible and thus successfully contestable. Finally, we analyze how existing EU legislation connects to our framework and argue that individuals already hold some legal rights to these forms of evidence.

可争议性可解释AI算法问责欧盟法规

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。