构建统一评估框架,系统梳理解释型AI的评测方法
Unifying VXAI: A Systematic Review and Framework for the Evaluation of Explainable AI
- 基于362篇文献归纳出41类可比评价指标
- 提出三维分类体系覆盖解释类型、上下文与质量要求
- 为解释型AI方法比较提供可复用的标准工具
现代人工智能系统多依赖深层神经网络等黑箱模型,其性能来自数百万参数的复杂结构,但缺乏透明性严重影响可信度。解释型AI(XAI)通过提供人类可理解的模型行为说明来缓解此问题。然而,这些解释的有效性需经严格评估。尽管已有大量XAI方法,领域内仍缺乏标准化评估协议和通用指标共识。为此,本文遵循PRISMA指南开展系统综述,整合362篇相关文献,提炼出41个功能相似的度量指标组,并提出一个三维度评估框架:解释类型、评估情境性及解释质量期望。该框架是迄今最全面、结构化的XAI评估体系,支持度量选择的系统化,提升不同方法间的可比性,并为未来扩展提供灵活基础。
原文摘要 · Abstract (English)
Modern AI systems frequently rely on opaque black-box models, most notably Deep Neural Networks, whose performance stems from complex architectures with millions of learned parameters. While powerful, their complexity poses a major challenge to trustworthiness, particularly due to a lack of transparency. Explainable AI (XAI) addresses this issue by providing human-understandable explanations of model behavior. However, to ensure their usefulness and trustworthiness, such explanations must be rigorously evaluated. Despite the growing number of XAI methods, the field lacks standardized evaluation protocols and consensus on appropriate metrics. To address this gap, we conduct a systematic literature review following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines and introduce a unified framework for the eValuation of XAI (VXAI). We identify 362 relevant publications and aggregate their contributions into 41 functionally similar metric groups. In addition, we propose a three-dimensional categorization scheme spanning explanation type, evaluation contextuality, and explanation quality desiderata. Our framework provides the most comprehensive and structured overview of VXAI to date. It supports systematic metric selection, promotes comparability across methods, and offers a flexible foundation for future extensions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。