arXiv:2603.05761cs.LG2026-03

提出统一框架,让生成模型编辑更精准稳定

Score-Guided Proximal Projection: A Unified Geometric Framework for Rectified Flow Editing

  • 用能量优化方法平衡输入保真度与生成真实感
  • 理论证明能将异常输入拉回数据流形,收敛到后验最优
  • 兼容现有编辑方法,支持自由度可调的无训练编辑

Rectified Flow(RF)模型在生成质量上达到顶尖水平,但对其精确控制(如语义编辑或盲图像恢复)仍具挑战。现有方法分为基于反演的引导(易受几何锁定限制)和后验采样近似(计算成本高且不稳定)。本文提出Score-Guided Proximal Projection(SGPP),将恢复任务重构为近端优化问题,构建一个兼顾输入保真度与预训练得分场真实性的能量景观。理论证明该目标具备法向收缩性质,几何保证异常输入被拉至数据流形,并有效收敛至流形约束下的后验模式。关键在于,SGPP统一了先进编辑方法:RF反演是其极限情形;通过放宽近端方差,实现‘软引导’,提供无需训练的、从严格身份保持到生成自由之间的连续权衡。

原文摘要 · Abstract (English)

Rectified Flow (RF) models achieve state-of-the-art generation quality, yet controlling them for precise tasks -- such as semantic editing or blind image recovery -- remains a challenge. Current approaches bifurcate into inversion-based guidance, which suffers from "geometric locking" by rigidly adhering to the source trajectory, and posterior sampling approximations (e.g., DPS), which are computationally expensive and unstable. In this work, we propose Score-Guided Proximal Projection (SGPP), a unified framework that bridges the gap between deterministic optimization and stochastic sampling. We reformulate the recovery task as a proximal optimization problem, defining an energy landscape that balances fidelity to the input with realism from the pre-trained score field. We theoretically prove that this objective induces a normal contraction property, geometrically guaranteeing that out-of-distribution inputs are snapped onto the data manifold, and it effectively reaches the posterior mode constrained to the manifold. Crucially, we demonstrate that SGPP generalizes state-of-the-art editing methods: RF-inversion is effectively a limiting case of our framework. By relaxing the proximal variance, SGPP enables "soft guidance," offering a continuous, training-free trade-off between strict identity preservation and generative freedom.

生成模型图像编辑扩散模型优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。