arXiv:2410.12803cs.CYcs.LG2024-10被引 3

为表格数据的可解释AI评估制定实用指南,解决现有方法不适用的问题。

Developing Guidelines for Functionally-Grounded Evaluation of Explainable Artificial Intelligence using Tabular Data

  • 基于文献分析提炼20项评估标准,明确每种标准的适用场景与方法。
  • 指出当前评估方法可能在表格数据上产生偏差,影响结果可靠性。
  • 适合研究可解释AI评估、特别是表格数据应用场景的研究者参考。

可解释人工智能(XAI)技术用于提升复杂预测模型的透明度,但这些技术多针对图像和文本数据设计,其在表格数据上的适用性尚不明确。由于缺乏对表格数据场景下XAI评估的系统考察,现有评估准则与方法的有效性也存疑。例如,某些研究发现评估方法本身可能在表格数据上产生偏差,从而扭曲评估结果。本文通过梳理XAI评估相关文献,提出面向局部后验XAI技术的功能性评估指南,识别出20项评估标准及其对应方法,并说明每项标准的适用条件与实施方式。同时,指出了未来研究的关键空白。本工作深化了对功能化评估协议的理解,为后续研究奠定了基础。

原文摘要 · Abstract (English)

Explainable Artificial Intelligence (XAI) techniques are used to provide transparency to complex, opaque predictive models. However, these techniques are often designed for image and text data, and it is unclear how fit-for-purpose they are when applied to tabular data. As XAI techniques are rarely evaluated in settings with tabular data, the applicability of existing evaluation criteria and methods are also unclear and needs (re-)examination. For example, some works suggest that evaluation methods may unduly influence the evaluation results when using tabular data. This lack of clarity on evaluation procedures can lead to reduced transparency and ineffective use of XAI techniques in real world settings. In this study, we examine literature on XAI evaluation to derive guidelines on functionally-grounded assessment of local, post hoc XAI techniques. We identify 20 evaluation criteria and associated evaluation methods, and derive guidelines on when and how each criterion should be evaluated. We also identify key research gaps to be addressed by future work. Our study contributes to the body of knowledge on XAI evaluation through in-depth examination of functionally-grounded XAI evaluation protocols, and has laid the groundwork for future research on XAI evaluation.

可解释AI评估指南表格数据XAI评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。