arXiv:2509.23357cs.LGmath.OC2025-09被引 7

用去噪方法在隐式数据流形上做优化,让生成模型直接参与设计任务。

Landing with the Score: Riemannian Optimization through Denoising

  • 通过链接函数将数据分布与流形优化操作关联,实现无需显式流形的优化。
  • 提出DLF和DRGD算法,理论保证近似流形保持与小梯度最优性。
  • 可复用扩散模型的预训练得分网络,适合生成式设计与控制场景。

在数据流形假设下,高维数据集中在低维流形附近。本文研究当流形仅通过数据分布隐式给出、传统流形操作不可用时的黎曼优化问题。该设定涵盖现代生成式AI中的大量数据驱动设计任务。核心思想是引入一个链接函数,将数据分布与优化所需的几何操作联系起来,成功恢复了收缩映射与黎曼梯度计算等关键操作。我们进一步揭示该构造与扩散模型中得分函数的直接关联,从而可利用成熟的参数化方式、高效训练流程甚至预训练得分网络进行优化。在此基础上,提出两种高效的推理时算法——去噪着陆流(DLF)与去噪黎曼梯度下降(DRGD),并提供可行性(近似流形保持)与最优性(小黎曼梯度范数)的理论保证。最后,在数据驱动控制中的有限时域参考追踪任务上验证了方法的有效性,展现了其在生成与设计应用中的潜力。

原文摘要 · Abstract (English)

Under the data manifold hypothesis, high-dimensional data are concentrated near a low-dimensional manifold. We study the problem of Riemannian optimization over such manifolds when they are given only implicitly through the data distribution, and the standard manifold operations required by classical algorithms are unavailable. This formulation captures a broad class of data-driven design problems that are central to modern generative AI. Our key idea is to introduce a link function that connects the data distribution to the geometric operations needed for optimization. We show that this function enables the recovery of essential manifold operations, such as retraction and Riemannian gradient computation. Moreover, we establish a direct connection between our construction and the score function in diffusion models of the data distribution. This connection allows us to leverage well-studied parameterizations, efficient training procedures, and even pretrained score networks from the diffusion model literature to perform optimization. Building on this foundation, we propose two efficient inference-time algorithms -- Denoising Landing Flow (DLF) and Denoising Riemannian Gradient Descent (DRGD) -- and provide theoretical guarantees for both feasibility (approximate manifold adherence) and optimality (small Riemannian gradient norm). Finally, we demonstrate the effectiveness of our approach on finite-horizon reference tracking tasks in data-driven control, highlighting its potential for practical generative and design applications.

生成模型黎曼优化扩散模型控制设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。