解释卡片让算法解释更可靠,帮用户正确理解决策依据。
We Need Explanation Cards to Connect Explanation Algorithms to the Real World

- 用补充信息和使用说明增强解释的可信度
- 让原本无用的解释变得可用,还能识别无效情况
- 适合政策执行者和开发者参考,落实欧盟AI法案
算法解释旨在帮助利益相关方理解黑箱决策,但实际效果常不理想。一方面,解释含义常与直觉不符,需专业知识才能准确解读;另一方面,现有主流解释方法对复杂决策函数的行为提供信息有限。这两点导致解释表面传达与实际价值之间存在鸿沟。本文提出「解释卡片」机制,为标准解释添加关于鲁棒性、有效性及解读指引的补充信息。这些补充内容使原本无意义的解释具备实用价值,同时能识别其失效场景。更重要的是,解释卡片将责任从用户转移至提供方:不再要求用户自行判断解释边界,而是由提供方事先明确说明。以反事实解释和SHAP为例,我们展示了如何构建解释卡片,并证明它们能有效指导用户进行合理解读。此外,解释卡片为落实欧盟《人工智能法案》中的可解释性要求提供了可行路径。总体而言,解释卡片是使解释算法真正适用于现实场景的重要一步。
原文摘要 · Abstract (English)
Algorithmic explanations are intended to help stakeholders understand opaque algorithmic decisions, but in practice, they often fall short. First, the meaning of algorithmic explanations is often not what one might intuitively expect, so expert knowledge is required to interpret them correctly. Second, recent work has shown that popular explanation algorithms are uninformative about the behavior of complex decision functions. Together, these issues create a gap between what explanations appear to convey and what they actually provide. In this work, we propose Explanation Cards for Explanation Algorithms, which augment standard explanations with complementary information about robustness and validity, as well as clear instructions for interpretation. The complementary information can render otherwise uninformative explanations practically useful, while also helping to detect cases where they are not. Importantly, the interpretation instructions in explanation cards shift responsibility from users to providers: Rather than expecting users to recognize what can and cannot be concluded from an explanation, providers must make this explicit upfront. Using counterfactual explanations and SHAP as examples, we demonstrate how providers can construct explanation cards and that these cards provide users with the guidance needed for sound interpretation. We further argue that explanation cards offer a practical means of operationalising the explainability provisions of the EU AI Act. Overall, explanation cards are a significant step toward making explanation algorithms fit for real-world use cases.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。