arXiv:2509.19670math.OCcs.LG2025-09

基于对偶证书设计高效在线大间距分类算法,误判更少、精度更高。

Efficient Online Large-Margin Classification via Dual Certificates

  • 利用对偶形式的几何洞察设计在线算法,保持平移不变性
  • 在理想条件下,每序列最多犯两次错,远优于感知机
  • 计算效率媲美现有方法,实测准确率显著提升

在线分类是优化、统计学习和数据科学中的核心问题。经典算法如感知机虽更新高效且对线性可分数据有有限误判保证,但未利用分类问题的几何结构。本文通过其对偶形式研究离线最大间隔问题,利用所得几何洞察设计了一种原理清晰且高效的在线算法。该方法的关键特性是继承自离线公式的平移不变性,在性能分析中起核心作用。理论分析表明,改进后的误判与间隔界仅依赖于平移不变量,在有利设置下比现有算法提供更强保证。特别地,我们识别出一种参数情形,此时算法每序列最多犯两次错误,而感知机可能被强迫产生任意多错误。真实数据上的数值实验进一步显示,该方法在计算效率上与现有在线算法相当,但在准确率上显著超越。

原文摘要 · Abstract (English)

Online classification is a central problem in optimization, statistical learning and data science. Classical algorithms such as the perceptron offer efficient updates and finite mistake guarantees on linearly separable data, but they do not exploit the underlying geometric structure of the classification problem. We study the offline maximum margin problem through its dual formulation and use the resulting geometric insights to design a principled and efficient algorithm for the online setting. A key feature of our method is its translation invariance, inherited from the offline formulation, which plays a central role in its performance analysis. Our theoretical analysis yields improved mistake and margin bounds that depend only on translation-invariant quantities, offering stronger guarantees than existing algorithms under the same assumptions in favorable settings. In particular, we identify a parameter regime where our algorithm makes at most two mistakes per sequence, whereas the perceptron can be forced to make arbitrarily many mistakes. Our numerical study on real data further demonstrates that our method matches the computational efficiency of existing online algorithms, while significantly outperforming them in accuracy.

在线学习大间距分类对偶方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。