从初始超平面出发,逐步优化出最大间隔分类器。
An Iterative Geometric Approach to Optimizing Separating Hyperplanes
- 基于局部数据集迭代重对齐超平面,逐步提升间隔。
- 在大样本上表现优于直接求解的主流方法。
- 适合已有良好初始超平面的场景,如增量学习。
针对二分类线性可分数据集,目标是计算最大间隔分离超平面,即硬边际支持向量机(SVM)分类器。本文探讨:若已知一个初始分离超平面,能否利用它更高效地逼近最优解。提出一种几何方法,从初始超平面出发,通过逐步改善其方向,保持分离性并持续增大间隔,直至收敛到全局最优。每轮迭代仅依赖当前活动集的局部信息,旨在根据该子集的最优分离超平面重新对齐整体超平面。因此,将原凸二次规划问题转化为一系列更小的子问题求解。论文详细描述了算法,并提供了初步实验评估与若干理论结果。结果表明,在存在初始分离超平面时,该方法在较大数据集上具有竞争力,某些情况下甚至优于直接求解优化问题的先进方法。
原文摘要 · Abstract (English)
Given a binary-labeled linearly separable dataset, and the objective is to compute the maximum-margin separating hyperplane, also known as the hard-margin Support Vector Machine (SVM) classifier. This paper investigates whether, if given an initial separating hyperplane, can it be exploited to reach this unique optimum more efficiently. We present a geometric approach that gradually improves the alignment of the hyperplane, starting from an initial separating hyperplane, while preserving separation and continuously increasing its margin until convergence to the global optimum. At each iteration, the method considers only local information, namely the current active set, and aims to re-align the hyperplane according to the optimal separating hyperplane of this reduced subset. Consequently, the original convex quadratic optimization problem is addressed through a sequence of smaller subproblems. The paper presents the algorithm in detail, together with a preliminary experimental evaluation and several theoretical findings. The results suggest that, when an initial separating hyperplane is available, the proposed method can be competitive on larger datasets and, in some cases, can outperform state-of-the-art approaches that solve the optimization problem directly.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。