用真实数据实例迁移提升低资源场景下解释的准确性与稳定性
ITL-LIME: Instance-Based Transfer Learning for Enhancing Local Explanations in Low-Resource Data Settings
- 从相关领域提取真实实例,替代随机扰动生成
- 结合目标实例邻域与相似源域实例,构建更可信局部区域
- 通过对比学习加权,增强解释结果的一致性,适合小样本场景
可解释人工智能(XAI)方法如局部可解释模型无关解释(LIME)通过可解释的代理模型局部逼近黑箱模型行为,提升了模型可解释性。然而,LIME在扰动和采样中存在固有随机性,导致局部性和不稳定性问题,尤其在训练数据有限时更为显著。数据稀缺可能导致生成不符合真实数据流形的虚假样本,使代理模型无法准确逼近原始模型的复杂决策边界。为此,我们提出一种基于实例的迁移学习LIME框架(ITL-LIME),以提升数据受限环境下的解释保真度与稳定性。ITL-LIME将实例迁移学习引入LIME框架,利用相关源域中的真实实例辅助目标域的解释过程。具体而言,通过聚类将源域划分为若干簇,并生成代表性原型;不生成随机扰动,而是检索与目标实例最相似源簇原型所对应的源实例。这些源实例与目标实例的邻近真实样本组合成候选集。为进一步定义紧凑局部性,我们构建基于对比学习的编码器作为加权机制,根据实例与目标实例的接近程度分配权重。最终,使用加权后的源与目标实例训练代理模型用于解释。
原文摘要 · Abstract (English)
Explainable Artificial Intelligence (XAI) methods, such as Local Interpretable Model-Agnostic Explanations (LIME), have advanced the interpretability of black-box machine learning models by approximating their behavior locally using interpretable surrogate models. However, LIME's inherent randomness in perturbation and sampling can lead to locality and instability issues, especially in scenarios with limited training data. In such cases, data scarcity can result in the generation of unrealistic variations and samples that deviate from the true data manifold. Consequently, the surrogate model may fail to accurately approximate the complex decision boundary of the original model. To address these challenges, we propose a novel Instance-based Transfer Learning LIME framework (ITL-LIME) that enhances explanation fidelity and stability in data-constrained environments. ITL-LIME introduces instance transfer learning into the LIME framework by leveraging relevant real instances from a related source domain to aid the explanation process in the target domain. Specifically, we employ clustering to partition the source domain into clusters with representative prototypes. Instead of generating random perturbations, our method retrieves pertinent real source instances from the source cluster whose prototype is most similar to the target instance. These are then combined with the target instance's neighboring real instances. To define a compact locality, we further construct a contrastive learning-based encoder as a weighting mechanism to assign weights to the instances from the combined set based on their proximity to the target instance. Finally, these weighted source and target instances are used to train the surrogate model for explanation purposes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。