针对混合特征的不平衡数据,提出新采样方法提升银行客户评分预测效果。
Harnessing Mixed Features for Imbalance Data Oversampling: Application to Bank Customers Scoring
- 用核密度估计和广义随机森林生成连续与分类特征。
- 生成样本保持类别组合一致性和特征间相关性,提升模型性能。
- 在银行真实数据上表现优异,符合监管要求,适合金融场景使用。
本研究探讨二分类任务中表格数据的罕见事件检测。标准处理类别不平衡的方法如SMOTE通过生成少数类合成样本提升性能,但其仅适用于连续变量。尽管存在SMOTE-NC(支持混合特征的扩展版本),但针对混合特征的合成方法仍较少。现实中大量应用(如银行业务)涉及混合特征,显著影响预测效果。为此,本文提出MGS-GRF方法:利用局部全秩协方差的核密度估计生成连续特征,分类特征则通过广义随机森林从原始样本中抽取。实证表明,与SMOTE-NC相比,MGS-GRF具备两大特性:(i)一致性——仅生成原数据中存在的类别组合;(ii)关联性——保留连续与分类特征间的依赖关系。我们在模拟数据、公开数据集及某头部金融机构的私有数据集上评估了多种策略的性能。结果显示,具备一致性和关联性的合成方法在多个指标(如PR AUC、ROC AUC)上表现更优,其中MGS-GRF为最佳。此外,该方法在银行实际应用中表现良好,开发流程符合监管要求。
原文摘要 · Abstract (English)
This study investigates rare event detection on tabular data within binary classification. Standard techniques to handle class imbalance include SMOTE, which generates synthetic samples from the minority class. However, SMOTE is intrinsically designed for continuous input variables. In fact, despite SMOTE-NC-its default extension to handle mixed features (continuous and categorical variables)-very few works propose procedures to synthesize mixed features. On the other hand, many real-world classification tasks, such as in banking sector, deal with mixed features, which have a significant impact on predictive performances. To this purpose, we introduce MGS-GRF, an oversampling strategy designed for mixed features. This method uses a kernel density estimator with locally estimated full-rank covariances to generate continuous features, while categorical ones are drawn from the original samples through a generalized random forest. Empirically, contrary to SMOTE-NC, we show that MGS-GRF exhibits two important properties: (i) the coherence i.e. the ability to only generate combinations of categorical features that are already present in the original dataset and (ii) association, i.e. the ability to preserve the dependence between continuous and categorical features. We also evaluate the predictive performances of LightGBM classifiers trained on data sets, augmented with synthetic samples from various strategies. Our comparison is performed on simulated and public real-world data sets, as well as on a private data set from a leading financial institution. We observe that synthetic procedures that have the properties of coherence and association display better predictive performances in terms of various predictive metrics (PR and ROC AUC...), with MGS-GRF being the best one. Furthermore, our method exhibits promising results for the private banking application, with development pipeline being compliant with regulatory constraints.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。