arXiv:2412.01365cs.LGcs.AI2024-12被引 3

分离特征重要性与相关性,让模型决策更透明可解释。

Explaining the Unexplained: Revealing Hidden Correlations for Better Interpretability

  • 将Shapley值分解为单个特征和相关性贡献,精准量化影响。
  • 在图像与文本任务中显著优于现有方法的可解释性表现。
  • 适合需要透明决策过程的医疗、金融等高风险领域应用。

深度学习在处理非结构化数据方面取得了显著成功,但其'黑箱'特性在敏感应用领域带来严峻挑战。现有可解释性方法常忽略特征相关性,且对模型决策路径评估不足。本文提出Real Explainer(RealExp),通过将Shapley值解耦为特征重要性和特征相关性重要性,结合特征相似性计算,精确量化个体特征贡献及其交互作用,提升解释的可靠性与细致度。同时,提出一种聚焦于揭示深度模型决策路径的新评估准则,超越传统准确率指标。在图像分类与文本情感分析两个非结构化数据任务上的实验表明,RealExp在可解释性上显著优于现有方法。案例研究进一步验证其价值:在图像分类中帮助从预训练模型中选择更具可解释性的模型;在文本分类中实现传统词袋模型逼近微调GPT-Ada的性能。

原文摘要 · Abstract (English)

Deep learning has achieved remarkable success in processing and managing unstructured data. However, its "black box" nature imposes significant limitations, particularly in sensitive application domains. While existing interpretable machine learning methods address some of these issues, they often fail to adequately consider feature correlations and provide insufficient evaluation of model decision paths. To overcome these challenges, this paper introduces Real Explainer (RealExp), an interpretability computation method that decouples the Shapley Value into individual feature importance and feature correlation importance. By incorporating feature similarity computations, RealExp enhances interpretability by precisely quantifying both individual feature contributions and their interactions, leading to more reliable and nuanced explanations. Additionally, this paper proposes a novel interpretability evaluation criterion focused on elucidating the decision paths of deep learning models, going beyond traditional accuracy-based metrics. Experimental validations on two unstructured data tasks -- image classification and text sentiment analysis -- demonstrate that RealExp significantly outperforms existing methods in interpretability. Case studies further illustrate its practical value: in image classification, RealExp aids in selecting suitable pre-trained models for specific tasks from an interpretability perspective; in text classification, it enables the optimization of models and approximates the performance of a fine-tuned GPT-Ada model using traditional bag-of-words approaches.

可解释性Shapley值特征相关性深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。