arXiv:2410.20873cs.AI2024-10被引 5

提出评估AI解释方法一致性的框架,助企业选对可解释方案。

Explainability in AI Based Applications: A Framework for Comparing Different Techniques

  • 设计新指标量化不同解释方法的一致性,支持可视化分析。
  • 在Vision Transformer上对比六种主流解释技术,发现差异显著。
  • 适合关注AI决策可信度的业务方与开发者参考。

人工智能在金融、医疗、零售等行业的业务流程中显著提升了决策能力,但近年来深度学习模型的黑箱特性使得解释其决策成为挑战。为应对这一问题,大量可解释性技术应运而生。然而,在实际应用中,如何选择在可理解性与准确性间取得平衡的解释方法仍是一大难题。本文提出一种新型评估框架,用于衡量不同可解释性技术输出结果的一致性。基于该方法,我们对六种主流可解释性技术进行了全面比较分析,以指导实践中的技术选型。所提通用方法在当前最流行的深度学习架构之一——Vision Transformer上进行验证。尤为关键的是,本文提出一种可视觉解读的新指标,用于衡量解释方法间的共识程度。通过提供实用框架,帮助理解多种解释技术的异同,本研究旨在推动可解释AI系统在商业场景中的更广泛应用。

原文摘要 · Abstract (English)

The integration of artificial intelligence into business processes has significantly enhanced decision-making capabilities across various industries such as finance, healthcare, and retail. However, explaining the decisions made by these AI systems poses a significant challenge due to the opaque nature of recent deep learning models, which typically function as black boxes. To address this opacity, a multitude of explainability techniques have emerged. However, in practical business applications, the challenge lies in selecting an appropriate explainability method that balances comprehensibility with accuracy. This paper addresses the practical need of understanding differences in the output of explainability techniques by proposing a novel method for the assessment of the agreement of different explainability techniques. Based on our proposed methods, we provide a comprehensive comparative analysis of six leading explainability techniques to help guiding the selection of such techniques in practice. Our proposed general-purpose method is evaluated on top of one of the most popular deep learning architectures, the Vision Transformer model, which is frequently employed in business applications. Notably, we propose a novel metric to measure the agreement of explainability techniques that can be interpreted visually. By providing a practical framework for understanding the agreement of diverse explainability techniques, our research aims to facilitate the broader integration of interpretable AI systems in business applications.

可解释AI模型解释视觉Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。