用可控扰动替代随机打乱,让模型解释更准确可信。
LIME-LLM: Probing Models with Fluent Counterfactuals, Not Broken Text
- 用单掩码单样本协议生成流畅且语义合理的输入
- 在三个数据集上比传统方法和生成式方法解释更精准
- 适合需要高可信度解释的NLP应用开发者
局部解释方法如LIME仍是可信AI的基础,但其在自然语言处理中的应用受限于随机词元屏蔽带来的语义无效输入。尽管近期方法如LLiMe使用大语言模型生成邻域以缓解此问题,却因无约束改写引入混淆变量,难以分离特征贡献。本文提出LIME-LLM框架,以假设驱动的受控扰动取代随机噪声,通过严格的“单掩码-单样本”协议及中性填充与边界填充策略,构建流畅、位于流形上的邻域,严格隔离特征影响。我们在CoLA、SST-2和HateXplain三个基准上评估该方法,以人工标注理由为真实标准,对比了LIME、SHAP、Integrated Gradients及生成式基线LLiMe。结果表明,LIME-LLM在黑箱NLP可解释性方面达到新标杆,显著优于传统扰动法与最新生成式方法。
原文摘要 · Abstract (English)
Local explanation methods such as LIME (Ribeiro et al., 2016) remain fundamental to trustworthy AI, yet their application to NLP is limited by a reliance on random token masking. These heuristic perturbations frequently generate semantically invalid, out-of-distribution inputs that weaken the fidelity of local surrogate models. While recent generative approaches such as LLiMe (Angiulli et al., 2025b) attempt to mitigate this by employing Large Language Models for neighborhood generation, they rely on unconstrained paraphrasing that introduces confounding variables, making it difficult to isolate specific feature contributions. We introduce LIME-LLM, a framework that replaces random noise with hypothesis-driven, controlled perturbations. By enforcing a strict "Single Mask-Single Sample" protocol and employing distinct neutral infill and boundary infill strategies, LIME-LLM constructs fluent, on-manifold neighborhoods that rigorously isolate feature effects. We evaluate our method against established baselines (LIME, SHAP, Integrated Gradients) and the generative LLiMe baseline across three diverse benchmarks: CoLA, SST-2, and HateXplain using human-annotated rationales as ground truth. Empirical results demonstrate that LIME-LLM establishes a new benchmark for black-box NLP explainability, achieving significant improvements in local explanation fidelity compared to both traditional perturbation-based methods and recent generative alternatives.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。