arXiv:2504.18133cs.LG2025-04被引 23

针对风险评估中的数据不平衡问题,优化树模型提升检测效果。

Tree Boosting Methods for Balanced andImbalanced Classification and their Robustness Over Time in Risk Assessment

  • 用超参调优增强XGBoost在不平衡数据上的表现
  • 数据量越大、类别越均衡,F1分数越高
  • 方法对时间变化有鲁棒性,适合长期风险监测

现实世界中的分类任务多为不平衡数据,给人工智能带来挑战,因少数类(极受关注)难以被准确识别。本文在不同规模和分布的数据集上(1K、10K、100K样本,正例占比5%~50%)实证评估树提升方法的表现。基于表格数据的XGBoost与改进版Imbalance-XGBoost被重点考察。研究提出一套数据预处理与超参数优化流程,在更大数据量下性能提升,且随着正例比例下降,F1分数降低但依然显著优于基于正负比的基线精度-召回率。简单采样平衡训练集无法持续提升性能并导致检测恶化;而合理调优能有效改善识别能力,但需依数据量与分布谨慎应用。最终方法在数据随时间变化时保持稳定,性能下降时可通过重训恢复。

原文摘要 · Abstract (English)

Most real-world classification problems deal with imbalanced datasets, posing a challenge for Artificial Intelligence (AI), i.e., machine learning algorithms, because the minority class, which is of extreme interest, often proves difficult to be detected. This paper empirically evaluates tree boosting methods' performance given different dataset sizes and class distributions, from perfectly balanced to highly imbalanced. For tabular data, tree-based methods such as XGBoost, stand out in several benchmarks due to detection performance and speed. Therefore, XGBoost and Imbalance-XGBoost are evaluated. After introducing the motivation to address risk assessment with machine learning, the paper reviews evaluation metrics for detection systems or binary classifiers. It proposes a method for data preparation followed by tree boosting methods including hyper-parameter optimization. The method is evaluated on private datasets of 1 thousand (K), 10K and 100K samples on distributions with 50, 45, 25, and 5 percent positive samples. As expected, the developed method increases its recognition performance as more data is given for training and the F1 score decreases as the data distribution becomes more imbalanced, but it is still significantly superior to the baseline of precision-recall determined by the ratio of positives divided by positives and negatives. Sampling to balance the training set does not provide consistent improvement and deteriorates detection. In contrast, classifier hyper-parameter optimization improves recognition, but should be applied carefully depending on data volume and distribution. Finally, the developed method is robust to data variation over time up to some point. Retraining can be used when performance starts deteriorating.

树模型不平衡分类风险评估超参优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。