arXiv:2603.07221cs.LGmath.FA2026-03

大间距让分类在任意度量空间中可学习,无需线性结构

Margin in Abstract Spaces

  • 用距离函数定义概念,间距超过3倍时即可学习
  • 存在通用常数阈值,超限时任何度量空间都可学
  • 证明了某些可大间距学习的类别无法嵌入线性空间

基于间隔的学习(如线性与核方法)是少数不依赖参数数量就能保证泛化性能的经典框架,因此成为现代过参数化学习的核心研究对象。本文探究该现象背后的最简数学结构:考虑任意度量空间中的简单间隔问题——概念由中心点定义,依据点到中心的距离是否小于 $r$ 或大于 $R$ 来分类。我们证明,当 $R > 3r$ 时,该类在任何度量空间下均可学习。这表明,只要间隔足够大,学习能力仅依赖于三角不等式,无需线性或解析结构。进一步地,我们将结果推广至由距离函数的有界线性组合定义的概念,并揭示一个尖锐阈值:存在一个通用常数,当间隔大于该常数时,该类在所有度量空间中可学习;低于该常数时,则存在不可学习的度量空间。最后,我们反问:是否所有基于间隔的学习都能通过嵌入到某个巴拿赫空间转化为线性分类?答案是否定的——我们构造了一个可间隔学习但无法嵌入任何线性可学习空间的类别。

原文摘要 · Abstract (English)

Margin-based learning, exemplified by linear and kernel methods, is one of the few classical settings where generalization guarantees are independent of the number of parameters. This makes it a central case study in modern highly over-parameterized learning. We ask what minimal mathematical structure underlies this phenomenon. We begin with a simple margin-based problem in arbitrary metric spaces: concepts are defined by a center point and classify points according to whether their distance lies below $r$ or above $R$. We show that whenever $R>3r$, this class is learnable in \emph{any} metric space. Thus, sufficiently large margins make learnability rely only on the triangle inequality, without any linear or analytic structure being necessary. Our first main result extends this phenomenon to concepts defined by bounded linear combinations of distance functions, and reveals a sharp threshold: there exists a universal constant such that whenever the margin is larger than this constant, the class is learnable in every metric space, while below it there exist metric spaces where it is not learnable at all. We then ask whether margin-based learnability can always be explained via an embedding into a linear space -- that is, reduced to linear classification in some Banach space through a kernel-type construction. We answer this negatively by demonstrating a margin learnable class that cannot be embedded into any Banach space in which linear classification with margins is learnable.

间隔学习度量空间泛化理论非线性结构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。