arXiv:2506.18761stat.MLcs.CG2025-06

在高噪声下,局部平均能精准还原数据流形结构。

Local Averaging Accurately Distills Manifold Structure From Noisy Data

  • 提出两轮小批量局部平均法,用于从噪声数据中恢复流形。
  • 理论证明平均点到真实流形距离受噪声标准差和流形直径约束。
  • 为高噪声场景下的去噪与降维方法提供理论支撑,适合算法研究者。

高维数据普遍存在于自然图像、科学数据等领域,通常位于低维流形附近。利用这一几何结构对信号去噪、重建和生成等下游任务至关重要。然而实际中流形未知,仅有带噪声的采样点。局部平均是揭示流形结构的基础方法,也是当前可证明的流形拟合与去噪方法的核心。但迄今为止,尚无工作在高噪声条件下严格分析局部平均的准确性。本文针对从 $d$ 维流形 $/mathcal M subset R^D$ 中抽取的噪声样本,分析了两轮小批量局部平均法在噪声水平接近流形曲率半径 $τ$ 时的表现。我们证明:以高概率,平均点 $hat q$ 满足 $d(hat q, /mathcal M) \leq σ\sqrt{d\left(1+\frac{κ\mathrm{diam}(/mathcal M)}{\log(D)}\right)}$,其中 $σ$ 为高斯噪声标准差,$ ext{diam}( ext{M})$ 为流形直径,$κ$ 为外在曲率上界。这是首个在 $σ\sqrt{D} \approx τ$ 的高噪声环境下对局部平均准确性的分析。该方法可作为多种低噪声可证明方法的预处理步骤,其框架亦为依赖局部平均的广泛去噪与降维方法提供理论基础。

原文摘要 · Abstract (English)

High-dimensional data are ubiquitous, with examples ranging from natural images to scientific datasets, and often reside near low-dimensional manifolds. Leveraging this geometric structure is vital for downstream tasks, including signal denoising, reconstruction, and generation. However, in practice, the manifold is typically unknown and only noisy samples are available. A fundamental approach to uncovering the manifold structure is local averaging, which is a cornerstone of state-of-the-art provable methods for manifold fitting and denoising. However, to the best of our knowledge, there are no works that rigorously analyze the accuracy of local averaging in a manifold setting in high-noise regimes. In this work, we provide theoretical analyses of a two-round mini-batch local averaging method applied to noisy samples drawn from a $d$-dimensional manifold $\mathcal M \subset \mathbb{R}^D$, under a relatively high-noise regime where the noise size is comparable to the reach $τ$. We show that with high probability, the averaged point $\hat{\mathbf q}$ achieves the bound $d(\hat{\mathbf q}, \mathcal M) \leq σ\sqrt{d\left(1+\frac{κ\mathrm{diam}(\mathcal {M})}{\log(D)}\right)}$, where $σ, \mathrm{diam(\mathcal M)},κ$ denote the standard deviation of the Gaussian noise, manifold's diameter and a bound on its extrinsic curvature, respectively. This is the first analysis of local averaging accuracy over the manifold in the relatively high noise regime where $σ\sqrt{D} \approx τ$. The proposed method can serve as a preprocessing step for a wide range of provable methods designed for lower-noise regimes. Additionally, our framework can provide a theoretical foundation for a broad spectrum of denoising and dimensionality reduction methods that rely on local averaging techniques.

流形学习去噪理论分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。