arXiv:2503.14873cs.LG2025-03被引 3

新SVM模型更抗噪声和不平衡数据,提升少数类表现

Robust Support Vector Machines for Imbalanced and Noisy Data via Benders Decomposition

  • 用计数代替惩罚,直接最小化误分类样本数
  • 在多个数据集上显著提升少数类F1分数(p<0.05)
  • 适合噪声多、类别不均衡的工业场景应用

本文提出一种新型支持向量机(SVM)公式,用于改善类别不平衡和噪声数据下的分类性能。与传统软间隔SVM不同,该模型不惩罚约束违反的大小,而是量化违反次数并最小化其频率。通过在原始SVM目标函数中引入二值变量替代传统松弛变量,并为每个误分类样本分配优先级和对应约束,构建混合整数规划模型,利用博登分解法高效求解。在OpenML公开数据集上进行的威尔科克斯检验显示,该模型在提升少数类F1分数和提高噪声数据分类准确率方面均显著优于软间隔SVM、加权SVM和NuSVC(p < 0.05)。此外,该模型还表现出更强的鲁棒性、偏向少数类的决策边界、更少的支持向量及更快的预测速度。模型已开源,提供Python实现。

原文摘要 · Abstract (English)

This study introduces a novel formulation to enhance Support Vector Machines (SVMs) in handling class imbalance and noise. Unlike the conventional Soft Margin SVM, which penalizes the magnitude of constraint violations, the proposed model quantifies the number of violations and aims to minimize their frequency. To achieve this, a binary variable is incorporated into the objective function of the primal SVM formulation, replacing the traditional slack variable. Furthermore, each misclassified sample is assigned a priority and an associated constraint. The resulting formulation is a mixed-integer programming model, efficiently solved using Benders decomposition. The proposed model's performance was benchmarked against existing models, including Soft Margin SVM, weighted SVM, and NuSVC. Two primary hypotheses were examined: 1) The proposed model improves the F1-score for the minority class in imbalanced classification tasks. 2) The proposed model enhances classification accuracy in noisy datasets. These hypotheses were evaluated using a Wilcoxon test across multiple publicly available datasets from the OpenML repository. The results supported both hypotheses (\( p < 0.05 \)). In addition, the proposed model exhibited several interesting properties, such as improved robustness to noise, a decision boundary shift favoring the minority class, a reduced number of support vectors, and decreased prediction time. The open-source Python implementation of the proposed SVM model is available.

SVM不平衡数据鲁棒学习优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。