BEE通过随机基线探索,自动适配不同评估指标生成最优解释图。
BEE: Metric-Adapted Explanations via Baseline Exploration-Exploitation
- 用可学习的随机张量模拟基线,通过探索-利用机制优化
- 在多个模型上优于当前最佳解释方法,提升各指标表现
- 适合需要多指标验证解释质量的研究者使用
解释性研究面临两大挑战:解释质量的精细评估,以及通过基线表示建模缺失信息。现有文献提出多种评估指标和基线表示,但尚无统一标准。本文发现不同指标对不同基线产生的解释图存在偏好。为此,提出基线探索-利用(BEE)方法,将基线建模为可学习的随机张量,通过上下文探索-利用过程优化混合基线分布,引入路径积分中的随机性。通过从学习到的分布中重采样基线,BEE生成一组全面的解释图,可从中选出针对特定指标表现最优的解释。在多种模型架构上的大量实验表明,BEE在各类客观评估指标下均显著优于现有先进方法。
原文摘要 · Abstract (English)
Two prominent challenges in explainability research involve 1) the nuanced evaluation of explanations and 2) the modeling of missing information through baseline representations. The existing literature introduces diverse evaluation metrics, each scrutinizing the quality of explanations through distinct lenses. Additionally, various baseline representations have been proposed, each modeling the notion of missingness differently. Yet, a consensus on the ultimate evaluation metric and baseline representation remains elusive. This work acknowledges the diversity in explanation metrics and baselines, demonstrating that different metrics exhibit preferences for distinct explanation maps resulting from the utilization of different baseline representations and distributions. To address the diversity in metrics and accommodate the variety of baseline representations in a unified manner, we propose Baseline Exploration-Exploitation (BEE) - a path-integration method that introduces randomness to the integration process by modeling the baseline as a learned random tensor. This tensor follows a learned mixture of baseline distributions optimized through a contextual exploration-exploitation procedure to enhance performance on the specific metric of interest. By resampling the baseline from the learned distribution, BEE generates a comprehensive set of explanation maps, facilitating the selection of the best-performing explanation map in this broad set for the given metric. Extensive evaluations across various model architectures showcase the superior performance of BEE in comparison to state-of-the-art explanation methods on a variety of objective evaluation metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。