arXiv:2506.20041cs.LGcs.AI2025-06被引 1

用局部敏感哈希动态降采样,提升多类不平衡数据流的分类性能。

LSH-DynED: A Dynamic Ensemble Framework with LSH-Based Undersampling for Evolving Multi-Class Imbalanced Classification

  • 结合局部敏感哈希与动态集成框架,实现对多数类的智能降采样。
  • 在23个真实数据集和10个半合成数据集上优于15种先进方法。
  • 适合处理高维、大规模、类别严重不均衡的实时数据流场景。

不平衡数据流分类在机器学习中面临巨大挑战,尤其在多类别情况下。尽管二分类不平衡数据流已受广泛关注,但针对多类别不平衡数据流的研究仍有限。有效应对动态不平衡比率是关键难题。本文提出LSH-DynED框架,首次将基于随机超平面投影的局部敏感哈希(LSH-RHP)引入动态集成多样性(DynED)框架,用于对多数类进行降采样,构建平衡训练集,从而提升集成模型预测性能。在23个真实世界和10个半合成数据集上,与15种先进方法对比,实验表明LSH-DynED在Kappa和mG-Mean指标上均表现更优,展现出对多类别非平稳数据流的强大适应性与鲁棒性。该方法在高维、大规模、显著类别不平衡的数据集中依然表现优异,具备良好的实际应用潜力。为促进复现,代码已开源。

原文摘要 · Abstract (English)

The classification of imbalanced data streams, which have unequal class distributions, is a key difficulty in machine learning, especially when dealing with multiple classes. While binary imbalanced data stream classification tasks have received considerable attention, only a few studies have focused on multi-class imbalanced data streams. Effectively managing the dynamic imbalance ratio is a key challenge in this domain. This study introduces a novel, robust, and resilient approach to address these challenges by integrating Locality Sensitive Hashing with Random Hyperplane Projections (LSH-RHP) into the Dynamic Ensemble Diversification (DynED) framework. To the best of our knowledge, we present the first application of LSH-RHP for undersampling in the context of imbalanced non-stationary data streams. The proposed method undersamples the majority classes by utilizing LSH-RHP, provides a balanced training set, and improves the ensemble's prediction performance. We conduct comprehensive experiments on 23 real-world and ten semi-synthetic datasets and compare LSH-DynED with 15 state-of-the-art methods. The results reveal that LSH-DynED outperforms other approaches in terms of both Kappa and mG-Mean effectiveness measures, demonstrating its capability in dealing with multi-class imbalanced non-stationary data streams. Notably, LSH-DynED performs well in large-scale, high-dimensional datasets with considerable class imbalances and demonstrates adaptation and robustness in real-world circumstances. To motivate our design, we review existing methods for imbalanced data streams, outline key challenges, and offer guidance for future work. For the reproducibility of our results, we have made our implementation available on GitHub.

数据流分类不平衡学习动态集成降采样

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。