用混合整数优化直接最大化评分系统的缓冲AUC,提升可解释性与预测性能。
Buffered AUC maximization for scoring systems via mixed-integer optimization
- 基于混合整数线性规划,直接优化缓冲AUC以提高评分系统性能。
- 在真实数据集上,新方法构建的评分系统AUC显著优于正则化与逐步回归基线。
- 适合需要高可解释性且要求精准分类的医疗、金融等场景使用。
评分系统是由少量解释变量组成、每个变量赋予小整数系数的线性分类器,具有高度可解释性,可手动完成预测而无需计算器。以往研究虽采用混合整数优化(MIO)构建评分系统,但未直接最大化AUC(受试者工作特征曲线下面积),而AUC是评估评分系统的重要指标。本文提出一种有效MIO框架,通过最大化缓冲AUC(bAUC)——即AUC的最紧凹下界——来直接优化评分系统。模型为混合整数线性优化(MILO)问题,引入组稀疏约束以控制评分系统中问题数量。在多个公开真实数据集上的实验表明,该方法构建的评分系统在AUC表现上显著优于基于正则化和逐步回归的基线方法。本研究推动了利用MIO技术开发高可解释分类模型的发展。
原文摘要 · Abstract (English)
A scoring system is a linear classifier composed of a small number of explanatory variables, each assigned a small integer coefficient. This system is highly interpretable and allows predictions to be made with simple manual calculations without the need for a calculator. Several previous studies have used mixed-integer optimization (MIO) techniques to develop scoring systems for binary classification; however, they have not focused on directly maximizing AUC (i.e., area under the receiver operating characteristic curve), even though AUC is recognized as an essential evaluation metric for scoring systems. Our goal herein is to establish an effective MIO framework for constructing scoring systems that directly maximize the buffered AUC (bAUC) as the tightest concave lower bound on AUC. Our optimization model is formulated as a mixed-integer linear optimization (MILO) problem that maximizes bAUC subject to a group sparsity constraint for limiting the number of questions in the scoring system. Computational experiments using publicly available real-world datasets demonstrate that our MILO method can build scoring systems with superior AUC values compared to the baseline methods based on regularization and stepwise regression. This research contributes to the advancement of MIO techniques for developing highly interpretable classification models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。