arXiv:2411.17128cs.LGcs.NE2024-11被引 7

提出新方法提升不平衡数据下SVM的分类精度。

Enhancing Imbalance Learning: A Novel Slack-Factor Fuzzy SVM Approach

  • 引入位置参数控制超平面扩展,减少误判。
  • 在多个真实数据集上F1、MCC和AUC-PR均优于基线。
  • 适合处理极端类别失衡问题,如医疗诊断数据。

现实应用中,类别不平衡数据给支持向量机(SVM)等机器学习算法带来挑战,尤其在处理不平衡、噪声和异常值方面。模糊支持向量机(FSVM)通过为样本分配不同模糊隶属度来缓解类别不平衡,但对不平衡数据敏感,可能导致评估不准确。近期提出的基于松弛因子的FSVM(SFFSVM)利用松弛因子根据误分类概率调整隶属度,从而修正由不同错误代价(DEC)产生的误分类。本文在SFFSVM基础上提出改进的松弛因子型FSVM(ISFFSVM),引入新颖的位置参数,有效约束DEC超平面的延伸,降低少数类样本被误判的风险。该参数确保松弛因子接近阈值的多数类样本获得较低隶属度,增强模型区分能力。在多样化的现实世界KEEL数据集上进行大量实验表明,所提ISFFSVM在所有测试中均获得更高的F1分数、马修斯相关系数(MCC)及精确率-召回率曲线下面积(AUC-PR),显著优于传统方法,尤其在严重类别失衡场景下表现突出。代码已开源: https://github.com/mtanveer1/ISFFSVM。

原文摘要 · Abstract (English)

In real-world applications, class-imbalanced datasets pose significant challenges for machine learning algorithms, such as support vector machines (SVMs), particularly in effectively managing imbalance, noise, and outliers. Fuzzy support vector machines (FSVMs) address class imbalance by assigning varying fuzzy memberships to samples; however, their sensitivity to imbalanced datasets can lead to inaccurate assessments. The recently developed slack-factor-based FSVM (SFFSVM) improves traditional FSVMs by using slack factors to adjust fuzzy memberships based on misclassification likelihood, thereby rectifying misclassifications induced by the hyperplane obtained via different error cost (DEC). Building on SFFSVM, we propose an improved slack-factor-based FSVM (ISFFSVM) that introduces a novel location parameter. This novel parameter significantly advances the model by constraining the DEC hyperplane's extension, thereby mitigating the risk of misclassifying minority class samples. It ensures that majority class samples with slack factor scores approaching the location threshold are assigned lower fuzzy memberships, which enhances the model's discrimination capability. Extensive experimentation on a diverse array of real-world KEEL datasets demonstrates that the proposed ISFFSVM consistently achieves higher F1-scores, Matthews correlation coefficients (MCC), and area under the precision-recall curve (AUC-PR) compared to baseline classifiers. Consequently, the introduction of the location parameter, coupled with the slack-factor-based fuzzy membership, enables ISFFSVM to outperform traditional approaches, particularly in scenarios characterized by severe class disparity. The code for the proposed model is available at \url{https://github.com/mtanveer1/ISFFSVM}.

SVM不平衡学习模糊逻辑分类优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。