评估企业级NLP模型解释的鲁棒性,发现大模型解释更稳定。
Robust Explanations for User Trust in Enterprise NLP Systems

- 用留一法遮蔽测试解释在用户噪声下的稳定性。
- 解码器大模型解释翻转率比编码器低73%,规模越大越稳定。
- 提供部署前可参考的成本-鲁棒性权衡曲线,适合合规场景。
企业NLP系统中稳健的解释对用户信任至关重要,但黑箱部署(仅限API访问)下预部署验证困难,现有研究也未充分说明解释在真实用户噪声下的稳定性,尤其在组织从编码器分类器迁移到解码器大模型时。为此,我们提出基于留一法遮蔽的统一黑箱鲁棒性评估框架,通过交换、删除、打乱和反向翻译等多重扰动,在多个严重程度下量化解释稳定性,以顶词翻转率衡量。在三个基准数据集上,对六种模型(包括BERT、RoBERTa、Qwen 7B/14B、Llama 8B/70B)共64,800次测试中发现,解码器大模型解释稳定性显著优于编码器基线(平均翻转率降低73%),且模型规模越大越稳定(7B到70B提升44%)。最终,我们将鲁棒性与推理成本关联,构建实用的成本-鲁棒性权衡曲线,支持合规敏感应用的模型与解释选择。
原文摘要 · Abstract (English)
Robust explanations are increasingly required for user trust in enterprise NLP, yet pre-deployment validation is difficult in the common case of black-box deployment (API-only access) where representation-based explainers are infeasible and existing studies provide limited guidance on whether explanations remain stable under real user noise, especially when organizations migrate from encoder classifiers to decoder LLMs. To close this gap, we propose a unified black-box robustness evaluation framework for token-level explanations based on leave-one-out occlusion, and operationalize explanation robustness with top-token flip rate under realistic perturbations (swap, deletion, shuffling, and back-translation) at multiple severity levels. Using this protocol, we conduct a systematic cross-architecture comparison across three benchmark datasets and six models spanning encoder and decoder families (BERT, RoBERTa, Qwen 7B/14B, Llama 8B/70B; 64,800 cases). We find that decoder LLMs produce substantially more stable explanations than encoder baselines (73% lower flip rates on average), and that stability improves with model scale (44% gain from 7B to 70B). Finally, we relate robustness improvements to inference cost, yielding a practical cost-robustness tradeoff curve that supports model and explanation selection prior to deployment in compliance-sensitive applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。