arXiv:2603.07860cs.LG2026-03被引 1

通过稀疏引导加速图像逆问题重建,提升速度与内存效率。

Sparse Scheduled Diffusion Guidance for Inverse Problems

  • 先在中间时刻采样后验分布,再用其作为引导反向扩散的起点。
  • 仅在关键步骤施加轻量级约束,避免全程数据一致性计算。
  • 适用于需要快速重建的图像恢复任务,尤其适合资源受限场景。

预训练扩散模型是贝叶斯逆问题的有效先验,但其后验采样通常代价高昂,因数据一致性引导需贯穿整个反向轨迹。现有方法虽可避免通过去噪器的向量-雅可比乘积,但仍依赖全程密集引导或昂贵的内部求解。本文提出稀疏调度扩散引导(Spin),该方法不从纯噪声开始后验采样,而是先在中间时间步 $t_*$ 从后验时间边缘采样,再以该状态作为引导反向扩散的热启动。在引导阶段,不再每步都施加测量约束,而仅在去噪器仍能清除伪影的关键时间步进行轻量级修正。该过程将先验优化与数据一致性解耦:先验提供去噪能力,轻量级像素空间优化强制满足测量约束,无需通过去噪器或解码器的反向传播。在 FFHQ 与 ImageNet 上的线性和非线性逆问题中,Spin 达到与现有方法相当的重建质量,且显著提升运行效率——在像素空间模型上快 2 倍,在潜在扩散模型上快达 50 倍,同时内存开销更低。

原文摘要 · Abstract (English)

Pretrained diffusion models are effective priors for Bayesian inverse problems, but posterior sampling with these priors is often costly because data-consistency guidance is applied throughout the full reverse trajectory. Existing methods have shown that vector-Jacobian products through the denoiser can sometimes be avoided, yet they typically still rely on dense guidance through the full trajectory or expensive inner solves. We introduce Sparse Scheduled Diffusion Guidance for Inverse Problems (Spin), a solver that avoids starting posterior sampling from pure noise. Spin first samples from a posterior time-marginal at an intermediate timestep $t_*$, and then uses that state as a warm start for a guided reverse diffusion process. At guidance time, instead of enforcing the measurement constraint at every denoising step, Spin applies lightweight corrections only at scheduled timesteps where the denoiser can still clean up artifacts. The resulting procedure decouples prior refinement from data consistency: the prior supplies denoising, while lightweight pixel-space optimization enforces the measurement constraint without backpropagation through the denoiser or decoder. Across linear and nonlinear inverse problems on FFHQ and ImageNet, Spin achieves competitive reconstruction quality with a substantially better runtime--memory profile, running 2x faster on pixel-space models and up to 50x faster on latent diffusion models, with lower memory costs.

图像重建扩散模型逆问题高效采样

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。