纠正合成数据偏差,提升少数类分类准确率
Bias-Corrected Data Synthesis for Imbalanced Learning
- 从多数类中借信息,构建偏差校正机制
- 在手写数字数据集上准确率显著提升
- 适用于多任务学习与因果推断等场景
数据不平衡问题中,正样本远少于负样本,导致分类模型难以平衡误报率与漏报率。常见方法是为少数类生成合成数据,再联合真实与合成数据训练模型。然而,合成数据依赖真实数据且无法准确还原原始分布,若直接视为真实数据会降低预测精度。本文针对合成数据引入的偏差,通过利用多数类信息提出一致估计量,并设计偏差校正流程,有效缓解合成数据的负面影响,提升预测准确率并避免过拟合。该方法拓展至不平衡多任务学习和因果推断等更广泛场景。理论分析给出了偏差估计误差界及预测性能提升保证。模拟实验与手写数字数据集分析验证了方法有效性。
原文摘要 · Abstract (English)
Imbalanced data, where the positive samples represent only a small proportion compared to the negative samples, makes it challenging for classification problems to balance the false positive and false negative rates. A common approach to addressing the challenge involves generating synthetic data for the minority group and then training classification models with both observed and synthetic data. However, since the synthetic data depends on the observed data and fails to replicate the original data distribution accurately, prediction accuracy is reduced when the synthetic data is naïvely treated as the true data. In this paper, we address the bias introduced by synthetic data and provide consistent estimators for this bias by borrowing information from the majority group. We propose a bias correction procedure to mitigate the adverse effects of synthetic data, enhancing prediction accuracy while avoiding overfitting. This procedure is extended to broader scenarios with imbalanced data, such as imbalanced multi-task learning and causal inference. Theoretical properties, including bounds on bias estimation errors and improvements in prediction accuracy, are provided. Simulation results and data analysis on handwritten digit datasets demonstrate the effectiveness of our method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。