arXiv:2510.24414cs.CV2025-10被引 1

为语义分割的可解释AI提供量化评估框架,提升模型透明度与可信度。

A Quantitative Evaluation Framework for Explainable AI in Semantic Segmentation

  • 构建像素级量化评估体系,结合空间与上下文复杂性设计指标。
  • 通过类激活映射方法验证框架高效、稳健且可靠。
  • 适合关注AI可解释性与安全应用的研究者与工程师。

随着人工智能在高风险、关键领域中的广泛应用,确保其透明性与可信度至关重要。可解释人工智能(XAI)成为应对这一挑战的有前景方案,但对其评估仍需严谨,以平衡模型复杂度、预测性能与可解释性之间的权衡。尽管分类任务的XAI评估已取得进展,针对语义分割的评估策略仍有限。且主观的可视化解释难以保证解释的准确性与稳定性。为此,本文提出一个全面的量化评估框架,用于评估语义分割中的XAI方法,综合考虑空间与上下文任务复杂性。该框架系统整合像素级评估策略与精心设计的度量标准,实现细粒度的可解释性分析。基于近期改进的类激活映射(CAM)方法的模拟结果表明,所提方法具备高效性、鲁棒性与可靠性,推动了透明、可信、可问责的语义分割模型发展。

原文摘要 · Abstract (English)

Ensuring transparency and trust in artificial intelligence (AI) models is essential as they are increasingly deployed in safety-critical and high-stakes domains. Explainable AI (XAI) has emerged as a promising approach to address this challenge; however, the rigorous evaluation of XAI methods remains vital for balancing the trade-offs between model complexity, predictive performance, and interpretability. While substantial progress has been made in evaluating XAI for classification tasks, strategies tailored to semantic segmentation remain limited. Moreover, objectively assessing XAI approaches is difficult, since qualitative visual explanations provide only preliminary insights. Such qualitative methods are inherently subjective and cannot ensure the accuracy or stability of explanations. To address these limitations, this work introduces a comprehensive quantitative evaluation framework for assessing XAI in semantic segmentation, accounting for both spatial and contextual task complexities. The framework systematically integrates pixel-level evaluation strategies with carefully designed metrics to yield fine-grained interpretability insights. Simulation results using recently adapted class activation mapping (CAM)-based XAI schemes demonstrate the efficiency, robustness, and reliability of the proposed methodology. These findings advance the development of transparent, trustworthy, and accountable semantic segmentation models.

可解释AI语义分割量化评估XAI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。