arXiv:2609.02155cs.LGcs.IT2026-09

随机投影虽保距离,却可能丢失关键几何信息。

Exact Limits of Random Projections for Preserving Geometry: Distance Recovery, Nearest-Neighbor Rankings, and Covariance Shape in Gaussian Models

  • 通过线性压缩后最优重构器分析几何特征保留度
  • 当维度比 $m/d$ 很小时,最近邻匹配率趋近 $1/q$
  • JL 保证的距离保真不等于实际可用的几何信息

Johnson-Lindenstrauss (JL) 引理表明,将 $n$ 个点投影到 $m=O(\varepsilon^{-2}"log n)$ 维空间可以以高概率保持两两平方距离的相对误差在 $ 3 epsilon$ 内,且该维数阶数渐近最优。但在高维中,距离集中于基线,真正有用的几何信息存在于微小波动中。我们证明,JL 界可能对保留的几何毫无意义:一个独立的高斯替换映射也能满足该界,却与原始数据无关。接着研究任意解码器从线性草图中恢复平方距离特征 $f(D)$ 的能力。在平方误差损失下,最优解码器为条件期望,其奇异值量化了特征恢复能力。对于各向同性高斯数据($ 3 Sigma= 3 sigma^2 I_d$),我们闭式对角化该算子。固定 $k$ 且 $m,d-m\to\infty$ 时,第 $k$ 个奇异值满足 $\ell_k\approx(m/ d)^{k/2}$。由此得出三个精确结论:秩-$m$ 草图最多保留任一平方距离特征的 $m/d$ 比例方差;若 $m\to\infty$ 且 $m/d\to0$,期望肯德尔相关为 $\frac{2}{\pi}\sqrt{m/d}(1+o(1))$;对固定 $q$,最近邻一致率趋于 $1/q$。然而,单次投影可满足 JL 界,而平均肯德尔相关在 $\log n\ll m\ll d$ 时趋于零。去除尺度后,海氏平均保留的协方差形状信息为 $(m/d)^2$。因此,JL 距离保真并不能反映可用于比较或推断的几何信息。

原文摘要 · Abstract (English)

The Johnson-Lindenstrauss (JL) lemma guarantees that a random projection of $n$ points to $m=O(\varepsilon^{-2}\log n)$ dimensions preserves pairwise squared distances within relative error $\varepsilon$ with high probability, and this dimension order is asymptotically optimal. In high dimensions, however, distances concentrate around a baseline while key geometric information lies in much smaller fluctuations. We show that the JL bound can therefore be uninformative about retained geometry: an independent Gaussian replacement map can satisfy it even though the replacement cloud is independent of the original data. We then ask how well any decoder can recover a feature $f(D)$ of a squared distance $D$ from a linear sketch. Under squared-error loss, the optimal decoder is conditional expectation, so recovery defines a linear operator whose singular values quantify feature recovery. For isotropic Gaussian data ($\Sigma=\sigma^2 I_d$), we diagonalize this operator in closed form. For fixed $k$ with $m,d-m\to\infty$, its $k$th singular value satisfies $\ell_k\approx(m/ d)^{k/2}$. This yields three sharp consequences. A rank-$m$ sketch retains at most an $m/d$ fraction of the variance of any feature of one squared distance. If $m\to\infty$ and $m/d\to0$, the expected Kendall correlation is $\frac{2}{\pi}\sqrt{m/d}(1+o(1))$; for fixed $q$, nearest- neighbor agreement tends to $1/q$. Yet one projection can satisfy the JL bound while mean Kendall correlation vanishes when $\log n\ll m\ll d$. After removing scale, Haar-averaged retained covariance-shape information is $(m/d)^2$. Thus JL distance preservation does not quantify the geometry available for comparison or inference.

降维几何保真随机投影高维统计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。