先去噪再增强,提升小样本分类效果
iHHO-SMOTe: A Cleansed Approach for Handling Outliers and Reducing Noise to Improve Imbalanced Data Classification
- 先用随机森林选特征,再用DBSCAN剔除少数类异常点
- 在多个数据集上AUC超0.99,F1-score超0.967,G-means达0.99
- 适合噪声多、类别不均衡的工业数据分类任务
不平衡数据分类仍是机器学习中的重大挑战,尤其在大数据场景下,各类别样本分布不均会严重影响分类器性能。虽然合成少数类过采样技术(SMOTE)通过生成少数类新样本缓解此问题,但在生成过程中易引入噪声和异常点。本文提出iHHO-SMOTe方法,首先通过随机森林进行特征选择,识别关键特征,再利用基于密度的空间聚类算法(DBSCAN)在选定特征空间中检测并剔除少数类中的异常点,形成清洁数据集,随后采用混合策略进行过采样。在多种数据集上的综合实验表明,该模型表现优异:AUC超过0.99,G-means高达0.99,F1-score持续高于0.967。这些结果共同验证了清洁化iHHO-SMOTe在噪声抑制与异常处理方面的有效性,是应对不平衡数据分类的有力方案。
原文摘要 · Abstract (English)
Classifying imbalanced datasets remains a significant challenge in machine learning, particularly with big data where instances are unevenly distributed among classes, leading to class imbalance issues that impact classifier performance. While Synthetic Minority Over-sampling Technique (SMOTE) addresses this challenge by generating new instances for the under-represented minority class, it faces obstacles in the form of noise and outliers during the creation of new samples. In this paper, a proposed approach, iHHO-SMOTe, which addresses the limitations of SMOTE by first cleansing the data from noise points. This process involves employing feature selection using a random forest to identify the most valuable features, followed by applying the Density-Based Spatial Clustering of Applications with Noise (DBSCAN) algorithm to detect outliers based on the selected features. The identified outliers from the minority classes are then removed, creating a refined dataset for subsequent oversampling using the hybrid approach called iHHO-SMOTe. The comprehensive experiments across diverse datasets demonstrate the exceptional performance of the proposed model, with an AUC score exceeding 0.99, a high G-means score of 0.99 highlighting its robustness, and an outstanding F1-score consistently exceeding 0.967. These findings collectively establish Cleansed iHHO-SMOTe as a formidable contender in addressing imbalanced datasets, focusing on noise reduction and outlier handling for improved classification models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。