对比六种XAI方法在主流语言模型上的表现,发现简化模型法最可靠。
Evaluating the Effectiveness of XAI Techniques for Encoder-Based Language Models
- 用四类指标统一评估六种XAI技术的可解释性效果。
- LIME在人类推理一致性和鲁棒性上表现最优,达0.9685分。
- 注意力可视化法一致性近乎完美,适合追求稳定解释的场景。
大型语言模型的黑箱特性亟需可解释AI(XAI)技术以提升透明度与可信度,但评估方法仍具挑战。本研究提出一个通用评估框架,包含四项核心指标:人类推理一致性(HA)、鲁棒性、一致性和对比性。我们对五类不同类型的六种可解释技术——模型简化(LIME)、扰动法(SHAP)、基于梯度的方法(InputXGradient、Grad-CAM)、逐层重要性传播(LRP)及基于注意力机制的可视化方法(AMV)——在五种编码器型语言模型(TinyBERT、BERTbase、BERTlarge、XLM-R large、DeBERTa-xlarge)上进行评估,使用IMDB影评和Tweet Sentiment Extraction(TSE)数据集。结果表明,模型简化类方法(LIME)在多数指标和模型中表现最佳,尤其在DeBERTa-xlarge上人类推理一致性高达0.9685,且随模型复杂度增加更显优势;AMV在鲁棒性上表现最佳,最低得分0.0020,一致性接近满分0.9999;而LRP在对比性上最优,复杂模型下最高达0.9371。
原文摘要 · Abstract (English)
The black-box nature of large language models (LLMs) necessitates the development of eXplainable AI (XAI) techniques for transparency and trustworthiness. However, evaluating these techniques remains a challenge. This study presents a general evaluation framework using four key metrics: Human-reasoning Agreement (HA), Robustness, Consistency, and Contrastivity. We assess the effectiveness of six explainability techniques from five different XAI categories model simplification (LIME), perturbation-based methods (SHAP), gradient-based approaches (InputXGradient, Grad-CAM), Layer-wise Relevance Propagation (LRP), and attention mechanisms-based explainability methods (Attention Mechanism Visualization, AMV) across five encoder-based language models: TinyBERT, BERTbase, BERTlarge, XLM-R large, and DeBERTa-xlarge, using the IMDB Movie Reviews and Tweet Sentiment Extraction (TSE) datasets. Our findings show that the model simplification-based XAI method (LIME) consistently outperforms across multiple metrics and models, significantly excelling in HA with a score of 0.9685 on DeBERTa-xlarge, robustness, and consistency as the complexity of large language models increases. AMV demonstrates the best Robustness, with scores as low as 0.0020. It also excels in Consistency, achieving near-perfect scores of 0.9999 across all models. Regarding Contrastivity, LRP performs the best, particularly on more complex models, with scores up to 0.9371.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。