用风险度量方法生成可被多数模型接受的最小输入变更说明。
Counterfactual Explanations for Model Ensembles Using Entropic Risk Measures
- 引入熵风险度量,通过可调参数控制解释在多少模型上有效。
- 在真实数据集上验证,能平衡变更成本与跨模型有效性。
- 适合需解释多模型决策的金融、招聘等高风险场景。
反事实解释指使机器学习模型输出改变所需的最小输入变动。在金融、教育、招聘等高风险应用中备受关注。实际决策常依赖多个模型组成的集成而非单一模型。尽管单模型反事实已有大量研究,但如何为集成模型生成统一反事实仍缺乏探索。各模型可能产生不同反事实,而要求所有模型一致会大幅增加成本。本文提出基于熵风险度量的新策略,将该凸风险度量融入约束优化框架,生成对多个模型均有效的反事实。其核心优势在于提供可调节参数,控制反事实在可接受比例的模型上成立。我们还证明,该方法在极限情况下可生成对所有模型都有效的反事实(即最坏情况下的极小极大解)。通过调整风险规避程度(由参数控制),研究了反事实成本与集成有效性之间的权衡。实验在真实世界数据集上验证了性能。
原文摘要 · Abstract (English)
Counterfactual explanations indicate the smallest change in input that can translate to a different outcome for a machine learning model. Counterfactuals have generated immense interest in high-stakes applications such as finance, education, hiring, etc. In several use-cases, the decision-making process often relies on an ensemble of models rather than just one. Despite significant research on counterfactuals for one model, the problem of generating a single counterfactual explanation for an ensemble of models has received limited interest. Each individual model might lead to a different counterfactual, whereas trying to find a counterfactual accepted by all models might significantly increase cost (effort). We propose a novel strategy to find the counterfactual for an ensemble of models using the perspective of entropic risk measure. Entropic risk is a convex risk measure that satisfies several desirable properties. We incorporate our proposed risk measure into a novel constrained optimization to generate counterfactuals for ensembles that stay valid for several models. The main significance of our measure is that it provides a knob that allows for the generation of counterfactuals that stay valid under an adjustable fraction of the models. We also show that a limiting case of our entropic-risk-based strategy yields a counterfactual valid for all models in the ensemble (worst-case min-max approach). We study the trade-off between the cost (effort) for the counterfactual and its validity for an ensemble by varying degrees of risk aversion, as determined by our risk parameter knob. We validate our performance on real-world datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。