用多个近优模型生成解释,让机器学习更透明可信。
Beyond the Single-Best Model: Rashomon Partial Dependence Profile for Trustworthy Explanations in AutoML
- 从多个接近最优的模型中整合特征影响图谱
- 在35个数据集上,单模型解释覆盖不足70%
- 适合对可靠性要求高的医疗金融场景
自动化机器学习系统虽能高效完成模型选择,但通常只关注单一最佳模型,忽略了解释中的不确定性,而这在以人为本的可解释人工智能中至关重要。为此,我们提出一种新框架,通过聚合一组近最优模型(即Rashomon集)的局部依赖图谱(PDP),将模型多样性融入解释生成过程,得到的Rashomon PDP能够捕捉解释变异性并揭示分歧区域,为用户提供更具信息量且包含不确定性的特征影响视图。为评估其有效性,我们引入两个量化指标:覆盖率与置信区间平均宽度,用于比较标准PDP与Rashomon PDP的一致性。在来自OpenML CTR23基准套件的35个回归数据集上的实验表明,大多数情况下Rashomon PDP的覆盖范围不足最佳模型PDP的70%,凸显了单一模型解释的局限性。研究结果表明,通过补充被忽略的信息,Rashomon PDP提升了模型解释的可靠性和可信度,尤其适用于对透明度和信心要求极高的高风险领域。
原文摘要 · Abstract (English)
Automated machine learning systems efficiently streamline model selection but often focus on a single best-performing model, overlooking explanation uncertainty, an essential concern in human centered explainable AI. To address this, we propose a novel framework that incorporates model multiplicity into explanation generation by aggregating partial dependence profiles (PDP) from a set of near optimal models, known as the Rashomon set. The resulting Rashomon PDP captures interpretive variability and highlights areas of disagreement, providing users with a richer, uncertainty aware view of feature effects. To evaluate its usefulness, we introduce two quantitative metrics, the coverage rate and the mean width of confidence intervals, to evaluate the consistency between the standard PDP and the proposed Rashomon PDP. Experiments on 35 regression datasets from the OpenML CTR23 benchmark suite show that in most cases, the Rashomon PDP covers less than 70% of the best model's PDP, underscoring the limitations of single model explanations. Our findings suggest that Rashomon PDP improves the reliability and trustworthiness of model interpretations by adding additional information that would otherwise be neglected. This is particularly useful in high stakes domains where transparency and confidence are critical.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。