用MARS和N球采样提升黑箱模型局部解释的精度
Beyond Linear Surrogates: High-Fidelity Local Explanations for Black-Box Models
- 用多元自适应回归样条建模非线性局部边界
- 相比基线方法,平均RMSE降低32%
- 适合需要高保真解释的可信AI应用
随着黑箱机器学习模型在高风险领域日益复杂和广泛应用,提供其预测解释变得至关重要。现有局部解释方法难以生成高保真解释。本文提出一种新型、模型无关的局部解释方法,结合多元自适应回归样条(MARS)与N球采样策略。MARS用于建模非线性局部边界,有效捕捉参考模型的内在行为,从而提升局部保真度;N球采样直接从目标分布中采样扰动样本,无需重新加权,进一步提高忠实性。在五个基准数据集上,以不同核宽进行评估,实验结果表明,该方法相较基线方法平均降低32%的均方根误差(RMSE),证明其能更准确地逼近黑箱模型的局部行为。统计分析显示,所有数据集上结果均显著更优。本研究推动了可解释AI的发展,为科研与实践社区提供了有益洞见。
原文摘要 · Abstract (English)
With the increasing complexity of black-box machine learning models and their adoption in high-stakes areas, it is critical to provide explanations for their predictions. Existing local explanation methods lack in generating high-fidelity explanations. This paper proposes a novel local model agnostic explanation method to generate high-fidelity explanations using multivariate adaptive regression splines (MARS) and N-ball sampling strategies. MARS is used to model non-linear local boundaries that effectively captures the underlying behavior of the reference model, thereby enhancing the local fidelity. The N-ball sampling technique samples perturbed samples directly from a desired distribution instead of reweighting, leading to further improvement in the faithfulness. The performance of the proposed method was computed in terms of root mean squared error (RMSE) and evaluated on five different benchmark datasets with different kernel width. Experimental results show that the proposed method achieves higher local surrogate fidelity compared to baseline local explanation methods, with an average reduction of 32% in root mean square error, indicating more accurate local approximations of the black-box model. Additionally, statistical analysis shows that across all benchmark datasets, the proposed approach results were statistically significantly better. This paper advances the field of explainable AI by providing insights that can benefit the broader research and practitioner community.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。