arXiv:2605.21428cs.LGcs.DS2026-05

提出多项式时间的多分类线性分类鲁棒学习方法,突破高维下误差瓶颈。

Polynomial-Time Robust Multiclass Linear Classification under Gaussian Marginals

  • 设计配对非正规学习框架,实现高效鲁棒分类
  • 对k=3时误差达opt+ε,一般情况误差为O(k^{3/2}√opt)+ε
  • 首次实现维度无关误差保证,适合高维多分类场景

研究在高斯分布下多分类线性分类器的鲁棒学习问题。给定来自ℝ^d × [k]上分布的带标签样本(x, y),其中x服从高斯分布,目标是输出一个假设,其错误率接近最优的k类线性分类器。虽然二分类(k=2)已有成熟算法理论,但对k≥3的情况知之甚少。即使k=3,先前的鲁棒算法在复杂度和表示大小上均存在关于精度逆的指数依赖。本文通过建立多分类线性分类器的新结构结果,设计出具有维度无关误差保证的全多项式时间鲁棒学习器。首先发现标准多分类感知机算法在干净标签与高斯边际下仍需超多项式样本与更新次数,揭示了二分类中不存在的基本障碍。主正向结果是基于配对非正规学习的框架,对任意k可实现误差≷ O(k^{3/2}√ opt)+ε;此外,基于局部化思想的更优框架对k=3可得误差O(opt)+ε,对几何规则的k类线性分类器可得误差poly(k)opt+ε。

原文摘要 · Abstract (English)

We study the task of agnostic learning of multiclass linear classifiers under the Gaussian distribution. Given labeled examples $(x, y)$ from a distribution over $\mathbb{R}^d \times [k]$, with Gaussian $x$-marginal, the goal is to output a hypothesis whose error is comparable to that of the best $k$-class linear classifier. While the binary case $k=2$ has a well-developed algorithmic theory, much less is known for $k \ge 3$. Even for $k=3$, prior robust algorithms incur exponential dependence on the inverse of the desired accuracy in both complexity and representation size. In this work, we develop new structural results for multiclass linear classifiers and use them to design fully polynomial-time robust learners with dimension-independent error guarantees. Our first result shows that the standard multiclass perceptron algorithm requires super-polynomially many samples and updates, even with clean labels and Gaussian marginals, revealing a basic obstruction absent in the binary case. Our main positive result is a pairwise improper-learning framework which yields an efficient learner with error $\widetilde O(k^{3/2}\sqrt{\mathrm{opt}})+ε$ for general $k$. Additionally, we develop a sharper localization-based framework which leads to error $O(\mathrm{opt})+ε$ for $k=3$, and error $\mathrm{poly}(k)\mathrm{opt}+ε$ for geometrically regular $k$-class linear classifiers.

多分类鲁棒学习高斯分布多项式时间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。