系统梳理数据不平衡的解决方法,帮你在不同场景选对工具。
Data Balancing Strategies: A Systematic Survey of Resampling and Augmentation Methods
- 从传统重采样到生成模型,全面归纳各类平衡策略
- 实证表明无万能方法,效果依赖数据特征与评估指标
- 适合数据科学家和算法工程师参考,尤其关注类别不平衡问题
数据集类别不平衡问题在机器学习中长期存在,常导致模型偏向多数类、性能下降。本文系统综述了数据平衡方法,涵盖基础过采样(如SMOTE及其变体:Borderline SMOTE、K-Means SMOTE、Safe-Level SMOTE)、自适应方法(MWMOTE、AMDO)、深度生成模型(生成对抗网络、变分自编码器、扩散模型)、欠采样技术(NearMiss、Tomek Links)、混合方法(SMOTE-ENN、SMOTE-Tomek、SMOTE+OCSVM)、集成策略(SMOTEBoost、RUSBoost、Balanced Random Forest、One-Sided Selection),以及多标签和聚类数据的专用方法。文章不仅分类描述,更深入分析各方法的假设前提、运行机制及适用性,涉及高维、异构特征、类别重叠与噪声等复杂情况。研究表明,无单一方法在所有场景下最优,选择需结合数据特性、分类器与评估指标。论文最后指出新兴方向:自监督学习应对不平衡、基于扩散模型的过采样、分布保持的重采样、知识蒸馏用于不平衡部署,以及大模型适配偏斜分布,并为实践者提供指南,为未来方法发展指明路径。
原文摘要 · Abstract (English)
Imbalanced datasets, where one class significantly outnumbers others, remain a persistent challenge in machine learning, often biasing predictions toward the majority class and degrading classifier performance. This paper provides a comprehensive, systematic review of data balancing methods, extending beyond foundational oversampling techniques such as the Synthetic Minority Oversampling Technique (SMOTE) and its variants (e.g., Borderline SMOTE, K-Means SMOTE, and Safe-Level SMOTE) to encompass advanced adaptive methods (MWMOTE, AMDO), deep generative models (generative adversarial networks, variational autoencoders, and diffusion models), undersampling techniques (NearMiss, Tomek Links), combination/hybrid methods (SMOTE-ENN, SMOTE-Tomek, and SMOTE+OCSVM), ensemble strategies (SMOTEBoost, RUSBoost, Balanced Random Forest, and One-Sided Selection), and specialized approaches for multi-label and clustered data. Beyond descriptive categorization, this review critically examines each method's underlying assumptions, operational mechanisms, and suitability for diverse data characteristics, including high dimensionality, mixed feature types, class overlap, and noise. Key findings demonstrate that no single method universally outperforms others; optimal selection depends critically on dataset characteristics, classifier choice, and evaluation metrics. The paper concludes by identifying emerging research directions, including self-supervised learning for imbalance, diffusion-based generative oversampling, distribution-preserving resampling, knowledge distillation for imbalanced deployment, and the adaptation of foundation models to skewed distributions, offering practical guidelines for practitioners and a roadmap for future methodological development.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。