arXiv:2412.03375cs.LG2024-12被引 5

用超球体和无类数据提升分类模型的鲁棒性与效率

Granular Ball Twin Support Vector Machine with Universum Data

  • 将数据表示为特征空间中的超球体,替代传统点形式
  • 在UCI数据集上准确率和计算效率均优于现有TSVM方法
  • 适合处理噪声数据和需要可解释性的分类任务

支持向量机分类常因仅依赖目标类别标注数据而性能受限,且对噪声和异常值敏感。结合来自无类数据(Universum)的先验知识和更稳健的数据表示,可提升准确率与效率。受此启发,本文提出一种新型粒度球孪生支持向量机(GBU-TSVM),在孪生支持向量机框架中融合无类样本与粒度球计算。不同于现有方法,该模型将数据实例表示为特征空间中的超球体而非点,显著增强模型对噪声和大规模数据的鲁棒性与计算效率。通过将数据点聚类为粒度球,实现更高效率、更强抗噪性及更好可解释性。同时引入无类数据,提供上下文信息,优化分类边界,提升整体准确率。在UCI基准数据集上的实验表明,GBU-TSVM在准确率与计算效率上均超越现有TSVM模型,展现出在数据表征与分类领域的新范式潜力。

原文摘要 · Abstract (English)

Classification with support vector machines (SVM) often suffers from limited performance when relying solely on labeled data from target classes and is sensitive to noise and outliers. Incorporating prior knowledge from Universum data and more robust data representations can enhance accuracy and efficiency. Motivated by these findings, we propose a novel Granular Ball Twin Support Vector Machine with Universum Data (GBU-TSVM) that extends the TSVM framework to leverage both Universum samples and granular ball computing during model training. Unlike existing TSVM methods, the proposed GBU-TSVM represents data instances as hyper-balls rather than points in the feature space. This innovative approach improves the model's robustness and efficiency, particularly in handling noisy and large datasets. By grouping data points into granular balls, the model achieves superior computational efficiency, increased noise resistance, and enhanced interpretability. Additionally, the inclusion of Universum data, which consists of samples that are not strictly from the target classes, further refines the classification boundaries. This integration enriches the model with contextual information, refining classification boundaries and boosting overall accuracy. Experimental results on UCI benchmark datasets demonstrate that the GBU-TSVM outperforms existing TSVM models in both accuracy and computational efficiency. These findings highlight the potential of the GBU-TSVM model in setting a new standard in data representation and classification.

支持向量机数据表征鲁棒分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。