用随机最优控制提升扩散模型图像逆问题重建质量
Stochastic Optimal Control Sampling for Diffusion Inverse Problems

- 将去噪过程建模为动力系统,每步动态调整采样路径
- 实现闭式控制更新,计算效率高于以往方法
- 兼容多种扩散模型,视觉质量与定量指标均更优
得益于强大的数据分布建模能力,扩散模型已成为解决图像逆问题的强大工具。核心在于可控地引导采样轨迹逼近观测值,同时遵循扩散先验。本文提出随机最优控制采样(SOCS),将去噪过程建模为动力系统,并通过随机最优控制(SOC)注入控制信号。以往基于SOC的方法需对整个采样轨迹进行优化,计算成本高。相比之下,我们推导出闭式控制更新公式,并在每一步采样中应用,将与测量一致的干净预测拉回去噪流。在SOCS中,可灵活调节控制强度以匹配扩散模型的原生能力,从而提升感知质量。该方法兼容多种线性随机微分方程骨干网络。大量实验表明,SOCS在多种图像逆任务中实现了准确的测量对齐重建,具有更高的视觉保真度和更强的定量性能。
原文摘要 · Abstract (English)
Benefiting from the strong ability to capture data distributions, diffusion models have become powerful tools for solving image inverse problems. The key is to controllably steer the sampling trajectory toward the measurements while respecting the diffusion prior. In this work, we introduce Stochastic Optimal Control Sampling (SOCS), which models the denoising process as a dynamical system and injects control signals via SOC. Previous SOC-based approach addresses inverse problems by optimizing over the entire trajectory, which is computationally expensive. In contrast, we derive a closed-form control update and apply it at each sampling step, pulling the measurement-consistent clean prediction back onto the denoising flow. In SOCS, we can readily modulate the control strength to align with the diffusion model's native capabilities and thereby enhance perceptual quality. Our method is compatible with a variety of linear stochastic differential equation backbones. Extensive experiments across a broad spectrum of image inverse tasks demonstrate that SOCS achieves accurate measurement-aligned reconstructions with improved visual fidelity and stronger quantitative performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。