arXiv:2512.17058cs.LG2025-12

揭示k近邻分类器在度量空间中普遍一致的充要条件。

Universal consistency of the $k$-NN rule in metric spaces and Nagata dimension. III

  • 从维度理论与实分析角度建立三类等价条件
  • 证明了强Lebesgue-Besicovitch性质是必要条件
  • 适用于研究机器学习理论的数学背景读者

我们确立了描述完备可分度量空间中k近邻分类器普遍一致性的最后一环,将其与维数理论的组合术语及实分析的基本性质相联系。以下条件等价:(1) k近邻分类器在空间X中普遍一致;(2) 对每个局部有限Borel测度,X中均满足强Lebesgue–Besicovitch微分性质;(3) X在Jun-Iti Nagata意义下是σ有限维的。条件(2)与(3)的等价性由Preiss(1983)提出,而(3)⇒(2)的详细证明仅见于Assouad与Quentin de Gromard(2006)。(2)⇒(1)由Cérou与Guyader(2006)建立。本文证明了(1)⇒(3)。此外,弱版本的Lebesgue–Besicovitch性质不足以保证一致性,例如海森堡群即为反例(此处修正了Kumari与Pestov(2024)中的错误主张)。反直觉的是,存在一种与通常距离一致等价的实数线度量,使得k近邻分类器失效。最后,还可添加一个等价条件:(4) 1近邻分类器的误差渐近不超过贝叶斯误差的两倍。

原文摘要 · Abstract (English)

We establish the last missing link allowing to describe those complete separable metric spaces $X$ in which the $k$ nearest neighbour classifier is universally consistent, both in combinatorial terms of dimension theory and via a fundamental property of real analysis. The following are equivalent: (1) The $k$-nearest neighbour classifier is universally consistent in $X$, (2) The strong Lebesgue--Besicovitch differentiation property holds in $X$ for every locally finite Borel measure, (3) $X$ is sigma-finite dimensional in the sense of Jun-Iti Nagata. The equivalence (2)$\iff$(3) was announced by Preiss (1983), while a detailed proof of the implication (3)$\Rightarrow$(2) has only appeared in Assouad and Quentin de Gromard (2006). The implication (2)$\Rightarrow$(1) was established by Cérou and Guyader (2006). We prove the implication (1)$\Rightarrow$(3). We further show that the weak (instead of strong) Lebesgue--Besicovitch property is insufficient for the consistency of the $k$-NN rule, as witnessed, for example, by the Heisenberg group (here we correct a wrong claim made in the previous article (Kumari and Pestov 2024)). A bit counter-intuitively, there is a metric on the real line uniformly equivalent to the usual distance but under which the $k$-NN classifier fails. Finally, another equivalent condition that can be added to the above is the Cover--Hart property: (4) the error of the $1$-nearest neighbour classifier is asymptotically at most twice as bad as the Bayes error.

机器学习度量空间分类器一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。