arXiv:2502.16819cs.LGmath.OC2025-02ICML被引 1

用优化思维提升数据去噪效率,实现在未知流形上快速精准去噪。

Fast, Accurate Manifold Denoising by Tunneling Riemannian Optimization

  • 将去噪转化为在线优化问题,逐点构建高效清洁信号优化器。
  • 混合阶方法保证全局最优,去噪误差显著低于传统近邻搜索。
  • 适合需要高精度与实时性的科学数据处理场景。

学习型去噪器在信号生成(如扩散模型)和重构(如压缩感知)中起核心作用,其成功源于对数据低维结构的利用。现有方法要么依赖局部近似需遍历全数据集,要么将去噪视为通用函数逼近,常牺牲效率与可解释性。本文研究从未知$d$维流形$M \in \mathbb{R}^D$中采样的新噪声数据点的高效去噪问题,仅使用噪声样本。提出一种测试时高效的流形去噪框架,将“学习去噪”重新定义为“学习优化”。技术创新包括:(i) 在线学习方法,仅用噪声数据逐点“生长”优化器;(ii) 混合阶方法,确保学习到的优化器达到全局最优,兼顾效率与近优去噪性能。理论分析验证了复杂度与去噪性能。实验表明,在科学流形上的复杂度-性能权衡显著优于基于穷举搜索的最近邻方法。

原文摘要 · Abstract (English)

Learned denoisers play a fundamental role in various signal generation (e.g., diffusion models) and reconstruction (e.g., compressed sensing) architectures, whose success derives from their ability to leverage low-dimensional structure in data. Existing denoising methods, however, either rely on local approximations that require a linear scan of the entire dataset or treat denoising as generic function approximation problems, often sacrificing efficiency and interpretability. We consider the problem of efficiently denoising a new noisy data point sampled from an unknown $d$-dimensional manifold $M \in \mathbb{R}^D$, using only noisy samples. This work proposes a framework for test-time efficient manifold denoising, by framing the concept of "learning-to-denoise" as "learning-to-optimize". We have two technical innovations: (i) online learning methods which learn to optimize over the manifold of clean signals using only noisy data, effectively "growing" an optimizer one sample at a time. (ii) mixed-order methods which guarantee that the learned optimizers achieve global optimality, ensuring both efficiency and near-optimal denoising performance. We corroborate these claims with theoretical analyses of both the complexity and denoising performance of mixed-order traversal. Our experiments on scientific manifolds demonstrate significantly improved complexity-performance tradeoffs compared to nearest neighbor search, which underpins existing provable denoising approaches based on exhaustive search.

去噪流形学习优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。