提出新方法解决扩散模型在图像修复中的条件采样偏差问题。
Conditional Diffusion Under Linear Constraints: Langevin Mixing and Information-Theoretic Guarantees
- 用投影Langevin初始化,结合引导反向去噪提升采样质量。
- 理论证明误差受观测与未观测部分的互信息控制,且与维度无关。
- 适合做图像修复、超分辨率等线性逆问题的研究者参考。
研究预训练扩散模型在零样本条件下对线性逆问题(如图像修补和超分辨率)进行条件采样。在这些问题中,观测仅确定未知信号的部分成分,剩余自由度需按正确的条件数据分布采样。现有基于投影的采样器通过在反向扩散过程中修正观测分量来保证测量一致性,但测量一致并不能决定可行集上概率质量的分布,可能导致条件采样偏差。我们通过得分函数的正则-切向分解分析此问题:对于高斯加噪情况,观测方向的得分由测量唯一确定,而切向条件得分未知。我们证明,用无条件切向得分替代条件得分所产生的误差,被一个与维度无关的条件互信息上界所控制。该结果给出了初始化误差与路径中得分不匹配误差的信息论分解。受理论启发,我们提出先使用投影Langevin初始化,再进行引导反向去噪的方法,在图像修补和超分辨率实验中优于强基线投影方法。
原文摘要 · Abstract (English)
We study zero-shot conditional sampling with pretrained diffusion models for linear inverse problems, including inpainting and super-resolution. In these problems, the observation determines only part of the unknown signal. The remaining degrees of freedom must be sampled according to the correct conditional data distribution. Existing projection-based samplers enforce measurement consistency by correcting the observed component during reverse diffusion. However, measurement consistency alone does not determine how probability mass should be distributed along the feasible set, and this can lead to biased conditional samples. We analyze this issue through a normal--tangent decomposition of the score function. For Gaussian noising, the observed-direction score is exactly determined by the measurement; only the tangent conditional score is unknown. We prove that the error from replacing this score by the unconditional tangent score is upper bounded by a dimension-free conditional mutual information between observed and unobserved components. This gives an information-theoretic decomposition into initialization and pathwise score-mismatch errors. Motivated by the theory, we propose a projected-Langevin initialization followed by guided reverse denoising, which outperforms a strong projection-based baseline in inpainting and super-resolution experiments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。