arXiv:2502.14597cs.LGcs.NE2025-02被引 1

用差分进化优化SVM,解决多类数据不平衡问题。

Multi-Class Imbalanced Learning with Support Vector Machines via Differential Evolution

  • 结合代价敏感与间隔调整,重构SVM约束条件
  • 在OVO框架下将多类问题转为二分类子问题求解
  • 无需验证集,直接通过自定义适应度函数寻优

支持向量机(SVM)是一种强大的分类算法,但传统SVM针对二分类且假设数据平衡。面对多类不平衡分类问题,本文提出基于差分进化(i-SVM-DE)的改进SVM方法。通过融合代价敏感策略与间隔修改机制,在约束中构建参数优化问题;采用一对一(OVO)策略将多类问题分解为多个二分类子问题,并通过拼接各子问题参数形成大规模优化问题。为高效求解该问题并同步学习各类别的支持向量,引入改进差分进化(DE)算法。不同于依赖验证集的常规做法,本文设计专用适应度函数在DE搜索过程中评估模型性能并获取最优参数。大量实验表明,i-SVM-DE在统计上显著优于多个基线方法。

原文摘要 · Abstract (English)

Support vector machine (SVM) is a powerful machine learning algorithm to handle classification tasks. However, the classical SVM is developed for binary problems with the assumption of balanced datasets. Obviously, the multi-class imbalanced classification problems are more complex. In this paper, we propose an improved SVM via Differential Evolution (i-SVM-DE) method to deal with it. An improved SVM (i-SVM) model is proposed to handle the data imbalance by combining cost sensitive technique and separation margin modification in the constraints, which formalize a parameter optimization problem. By using one-versus-one (OVO) scheme, a multi-class problem is decomposed into a number of binary subproblems. A large optimization problem is formalized through concatenating the parameters in the binary subproblems. To find the optimal model effectively and learn the support vectors for each class simultaneously, an improved differential evolution (DE) algorithm is applied to solve this large optimization problem. Instead of the validation set, we propose the fitness functions to evaluate the learned model and obtain the optimal parameters in the search process of DE. A series of experiments are carried out to verify the benefits of our proposed method. The results indicate that i-SVM-DE is statistically superior by comparing with the other baseline methods.

SVM不平衡学习差分进化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。