改进可解释模型EBM,让机器决策更透明、公平且稳定。
Pushing the Boundaries of Interpretability: Incremental Enhancements to the Explainable Boosting Machine
- 用贝叶斯优化和多目标函数提升模型超参数配置
- 在多个数据集上保持高准确率的同时改善决策公平性
- 适合关注模型可解释性与伦理合规的开发者与研究者
复杂机器学习模型在高风险领域的广泛应用使“黑箱”问题成为负责任AI研究的核心挑战。本文致力于改进当前最先进的透明模型——可解释提升机(Explainable Boosting Machine, EBM),通过三种方法:基于贝叶斯的靶向超参数优化、用于公平性的自定义多目标优化函数,以及针对冷启动场景的新型自监督预训练流程。所有方法在Adult Income、信用卡欺诈检测和UCI心脏病等标准数据集上评估。结果表明,尽管主指标ROC AUC仅略有提升,但模型决策行为出现微妙而重要的变化,凸显了超越单一性能指标的多维度评估价值。该工作推动构建不仅准确,而且稳健、公平、透明的机器学习系统,满足日益增长的法规与伦理要求。
原文摘要 · Abstract (English)
The widespread adoption of complex machine learning models in high-stakes domains has brought the "black-box" problem to the forefront of responsible AI research. This paper aims at addressing this issue by improving the Explainable Boosting Machine (EBM), a state-of-the-art glassbox model that delivers both high accuracy and complete transparency. The paper outlines three distinct enhancement methodologies: targeted hyperparameter optimization with Bayesian methods, the implementation of a custom multi-objective function for fairness for hyperparameter optimization, and a novel self-supervised pre-training pipeline for cold-start scenarios. All three methodologies are evaluated across standard benchmark datasets, including the Adult Income, Credit Card Fraud Detection, and UCI Heart Disease datasets. The analysis indicates that while the tuning process yielded marginal improvements in the primary ROC AUC metric, it led to a subtle but important shift in the model's decision-making behavior, demonstrating the value of a multi-faceted evaluation beyond a single performance score. This work is positioned as a critical step toward developing machine learning systems that are not only accurate but also robust, equitable, and transparent, meeting the growing demands of regulatory and ethical compliance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。