arXiv:2412.16209cs.LGstat.ML2024-12被引 2

树模型在不平衡数据下校准会失效,需用学习型校准方法。

Challenges in the calibration of tree-based models for imbalanced classification

  • 用欠采样训练树模型后,解析校准会受分裂特征数和采样率影响。
  • 发现决策树反而倾向少数类,与现有认知矛盾。
  • 建议改用能学习偏差模式的β校准等方法,避免解析校准。

在处理不平衡二分类问题时,常通过欠采样多数类以获得更平衡的训练集。但这会引入偏差,因模型学习的数据不完全代表目标总体。一种常见做法是基于多数类采样率,解析地将预测结果映射到新值以修正偏差。然而我们发现,对随机森林采用这种解析校准会产生负面影响:估计的先验概率同时依赖于随机森林中每节点考虑的特征数量和采样率。前者由随机森林和解析校准的已知性质解释,后者则通过证明决策树存在偏差得到说明。出人意料的是,决策树在欠采样数据上反而偏向少数类。这些发现表明,基于欠采样数据训练的树模型不应使用解析校准。更适合的方法是能学习原始模型偏差模式的校准方式(如β校准)。

原文摘要 · Abstract (English)

When using machine learning for imbalanced binary classification problems, it is common to subsample the majority class to create a (more) balanced training dataset. This biases the model's predictions because the model learns from data that is not fully representative of the underlying population of interest. One way of accounting for this bias is analytically mapping the resulting predictions to new values based on the sampling rate for the majority class. We show that calibrating a random forest this way has negative consequences, including prevalence estimates that depend on both the number of predictors considered at each split in the random forest and the sampling rate used. We explain the former using known properties of random forests and analytical calibration and the latter by demonstrating a bias in decision trees. In contradiction with much of the existing literature, we show that decision trees can be biased towards the minority class. These issues indicate that tree-based models trained on undersampled data should not be calibrated analytically. Calibration approaches that can learn a miscalibration pattern in the original model (e.g., beta calibration) are more suitable.

树模型不平衡分类校准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。