arXiv:2410.05786cs.LG2024-10被引 2

用分组球特征提升支持向量机的分类性能与抗噪能力

Enhanced Feature Based Granular Ball Twin Support Vector Machine

  • 以分组球为输入,通过随机投影和非线性激活构建增强特征空间
  • 在增强空间中使用双支持向量机,实现非平行超平面分类,提升泛化能力
  • 对噪声和异常值更鲁棒,适合处理含标签噪声或大规模数据集

本文提出基于增强特征的分组球双支持向量机(EF-GBTSVM)。该模型以分组球(GBs)的粗粒度表示作为输入,而非单个数据样本。通过随机投影将GBs映射至隐藏层特征空间,并结合非线性激活函数,再将原始特征与隐藏层特征在球心处拼接,形成随机向量函数链接(RVFL)空间,有效捕捉了分组球的细微特征信息。在此空间中,采用双支持向量机(TSVM)进行分类,生成非平行超平面,显著提升模型泛化性能。此外,分组球的粗粒度特性使模型对重采样具有强鲁棒性,降低噪声与异常值影响。我们在标准UCI与KEEL数据集上全面评估该模型,涵盖含标签噪声与无噪声场景;同时在NDC数据集上的实验验证了其处理大规模数据的能力。统计分析结果表明,所提模型在泛化能力、可扩展性与鲁棒性方面均显著优于基线模型。

原文摘要 · Abstract (English)

In this paper, we propose enhanced feature based granular ball twin support vector machine (EF-GBTSVM). EF-GBTSVM employs the coarse granularity of granular balls (GBs) as input rather than individual data samples. The GBs are mapped to the feature space of the hidden layer using random projection followed by the utilization of a non-linear activation function. The concatenation of original and hidden features derived from the centers of GBs gives rise to an enhanced feature space, commonly referred to as the random vector functional link (RVFL) space. This space encapsulates nuanced feature information to GBs. Further, we employ twin support vector machine (TSVM) in the RVFL space for classification. TSVM generates the two non-parallel hyperplanes in the enhanced feature space, which improves the generalization performance of the proposed EF-GBTSVM model. Moreover, the coarser granularity of the GBs enables the proposed EF-GBTSVM model to exhibit robustness to resampling, showcasing reduced susceptibility to the impact of noise and outliers. We undertake a thorough evaluation of the proposed EF-GBTSVM model on benchmark UCI and KEEL datasets. This evaluation encompasses scenarios with and without the inclusion of label noise. Moreover, experiments using NDC datasets further emphasize the proposed model's ability to handle large datasets. Experimental results, supported by thorough statistical analyses, demonstrate that the proposed EF-GBTSVM model significantly outperforms the baseline models in terms of generalization capabilities, scalability, and robustness. The source code for the proposed EF-GBTSVM model, along with additional results and further details, can be accessed at https://github.com/mtanveer1/EF-GBTSVM.

支持向量机特征增强抗噪分类大规模学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。