arXiv:2608.22874cs.LGcs.CV2026-08

揭示了神经嵌入流形的随机可分性,为类别间线性分离提供理论依据。

Stochastic Separability of Embedding Manifolds

  • 提出双层测度集中分析法,推导嵌入流形投影集中不等式。
  • 在均值不同、方差有界的条件下,样本几乎必然线性可分。
  • 适用于理解深度网络表示学习的几何机制,适合理论研究者。

神经生物学研究与表征学习发现,同一类别物体在高维神经空间中的表示呈现低维流形特征,且不同物体流形在这些空间中线性可分。然而,这一现象至今缺乏严格的理论验证。本文提出一种新的嵌入流形随机可分性定理。首先,在一般条件下建立嵌入流形的投影测度集中定理,提出一种新的两层测度集中分析技术,通过全期望定律统一两种估计界,导出测度集中不等式。基于该定理,进一步证明两个不同类别嵌入流形的随机可分性:若两数据集均值不同且总方差有界,只要投影方向满足非奇异条件,其样本便以高概率线性可分。主要贡献包括:1. 利用两层尾部界不等式,证明了高维空间中嵌入流形的投影集中性质;2. 识别出嵌入流形间随机可分性的非奇异条件,并严格证明了随机投影可分性定理。该定理不仅揭示了物体嵌入流形的几何与统计特性,还为深度网络表征学习提供了新机制。

原文摘要 · Abstract (English)

Neurobiological studies and representation learning have observed that representations of objects belonging to the same category in high-dimensional neural spaces exhibit low-dimensional object manifold characteristics, and different object manifolds are linearly separable in these neural spaces. However, these experimentally observed phenomena lack rigorous theoretical validation to date. This paper proposes a new stochastic separability theorem for embedding manifolds of two different object categories. First, we establish a projection measure concentration theorem for embedding manifolds under general conditions. We develop a new two-layer measure concentration analysis technique, which unifies two estimation bounds via the law of total expectation to derive measure concentration inequalities. Based on the measure concentration theorem, we further prove a stochastic separability theorem for embedding manifolds of two different object categories. If two datasets have distinct means and bounded total variances, their samples become linearly separable with high probability, provided that the projection direction satisfies a non-singularity condition. The main contributions of this paper are twofold: 1. We prove the projection concentration properties of embedding manifolds in high-dimensional spaces by using two-lawyer tail-bound inequalities. 2. We identify a non-singularity condition for the stochastic separability between embedding manifolds, and rigorously prove the stochastic projection separability theorem. The theorem not only uncovers geometric and statistical properties of the object embedding manifolds, but also provides a novel mechanism for representation learning in deep networks.

嵌入流形随机可分表示学习测度集中

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。