实证找到信用评分中数据增强的最佳比例,避免过度合成导致性能下降。
Finding the Sweet Spot: Optimal Data Augmentation Ratio for Imbalanced Credit Scoring Using ADASYN
- 用ADASYN在6.6:1比例下增广数据,效果优于完全平衡
- 1倍增广使AUC达0.6778,比1:1平衡提升3.00%(p=0.017)
- 发现合成过量会降低模型表现,适合金融风控从业者参考
信用评分模型面临严重类别不平衡问题,违约率通常低于10%,影响模型学习与预测性能。尽管已有SMOTE和ADASYN等生成合成数据的方法,但最优增广比例尚不明确,实践中常默认采用1:1的完全平衡。本研究系统评估了10种增广场景,使用Give Me Some Credit数据集(97,243条样本,7%违约率),对比SMOTE、BorderlineSMOTE与ADASYN在不同倍数(1x、2x、3x)下的表现,所有模型均基于XGBoost训练,并在29,173条独立测试样本上评估。通过1,000次自助法检验统计显著性。关键发现:ADASYN以1x倍数(少数类翻倍)增广时表现最优,AUC为0.6778,基尼系数为0.3557,分别较1:1平衡提升0.77%和3.00%(p=0.017)。更高倍数(2x、3x)导致性能下降,3x时AUC下降0.48%,表明合成增广存在“收益递减”现象。最优不平衡比为6.6:1(多数:少数),与常见1:1平衡做法相悖。本研究首次提供信用评分中数据增广“甜点”的实证依据,为行业与研究者提供可复现的优化框架,虽基于单一数据集,但方法可推广至其他不平衡领域。
原文摘要 · Abstract (English)
Credit scoring models face a critical challenge: severe class imbalance, with default rates typically below 10%, which hampers model learning and predictive performance. While synthetic data augmentation techniques such as SMOTE and ADASYN have been proposed to address this issue, the optimal augmentation ratio remains unclear, with practitioners often defaulting to full balancing (1:1 ratio) without empirical justification. This study systematically evaluates 10 data augmentation scenarios using the Give Me Some Credit dataset (97,243 observations, 7% default rate), comparing SMOTE, BorderlineSMOTE, and ADASYN at different multiplication factors (1x, 2x, 3x). All models were trained using XGBoost and evaluated on a held-out test set of 29,173 real observations. Statistical significance was assessed using bootstrap testing with 1,000 iterations. Key findings reveal that ADASYN with 1x multiplication (doubling the minority class) achieved optimal performance with AUC of 0.6778 and Gini coefficient of 0.3557, representing statistically significant improvements of +0.77% and +3.00% respectively (p = 0.017, bootstrap test). Higher multiplication factors (2x and 3x) resulted in performance degradation, with 3x showing a -0.48% decrease in AUC, suggesting a "law of diminishing returns" for synthetic oversampling. The optimal class imbalance ratio was found to be 6.6:1 (majority:minority), contradicting the common practice of balancing to 1:1. This work provides the first empirical evidence of an optimal "sweet spot" for data augmentation in credit scoring, with practical guidelines for industry practitioners and researchers working with imbalanced datasets. While demonstrated on a single representative dataset, the methodology provides a reproducible framework for determining optimal augmentation ratios in other imbalanced domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。