构建可复现的局部解释评估框架,助力公平敏感场景下模型可信性研究。
ExplainBench: A Benchmark Framework for Local Model Explanations in Fairness-Critical Applications
- 统一封装主流解释方法,支持端到端训练与解释生成。
- 在COMPAS等数据集上验证不同方法在保真度、稀疏性上的表现差异。
- 适合关注模型可解释性与公平性的研究人员及工程师使用。
随着机器学习系统在刑事司法、金融和医疗等高风险领域的广泛应用,对可解释且可信模型的需求日益增强。尽管局部解释技术(如SHAP、LIME、反事实方法)层出不穷,但在公平敏感场景中仍缺乏标准化、可复现的评估框架。本文提出ExplainBench,一个开源基准测试工具包,用于在具有伦理重要性的数据集上系统评估局部模型解释。该框架提供主流解释算法的统一接口,集成从模型训练到解释生成的完整流水线,并支持通过保真度、稀疏性和鲁棒性指标进行评估。其包含基于Streamlit的交互式界面,便于探索分析,同时以Python模块形式提供,便于融入研究流程。我们在常见公平性研究数据集(如COMPAS、UCI Adult Income、LendingClub)上展示了ExplainBench的应用,揭示了不同解释方法在统一实验协议下的行为差异。该框架推动了可解释机器学习的方法论发展,促进了真实世界AI系统的问责机制建设。
原文摘要 · Abstract (English)
As machine learning systems are increasingly deployed in high-stakes domains such as criminal justice, finance, and healthcare, the demand for interpretable and trustworthy models has intensified. Despite the proliferation of local explanation techniques, including SHAP, LIME, and counterfactual methods, there exists no standardized, reproducible framework for their comparative evaluation, particularly in fairness-sensitive settings. We introduce ExplainBench, an open-source benchmarking suite for systematic evaluation of local model explanations across ethically consequential datasets. ExplainBench provides unified wrappers for popular explanation algorithms, integrates end-to-end pipelines for model training and explanation generation, and supports evaluation via fidelity, sparsity, and robustness metrics. The framework includes a Streamlit-based graphical interface for interactive exploration and is packaged as a Python module for seamless integration into research workflows. We demonstrate ExplainBench on datasets commonly used in fairness research, such as COMPAS, UCI Adult Income, and LendingClub, and showcase how different explanation methods behave under a shared experimental protocol. By enabling reproducible, comparative analysis of local explanations, ExplainBench advances the methodological foundations of interpretable machine learning and facilitates accountability in real-world AI systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。