arXiv:2605.28711cs.LG2026-05中稿 · ICML

用单个扩散模型实现零样本逆问题中失真与感知质量的灵活权衡。

Stage-wise Distortion-Perception Traversal in Zero-shot Inverse Problems with Diffusion Models

论文配图:Stage-wise Distortion-Perception Traversal in Zero-shot Inverse Problems with Diffusion Models
图 1 · 摘自论文原文
  • 分阶段设计:先最大后验估计降失真,再重去噪提升感知质量。
  • 在多种任务上实现更优的失真-感知权衡,且保持高效求解能力。
  • 适用于真实世界逆问题,可适配大规模预训练扩散模型。

失真-感知(D-P)权衡是贝叶斯逆问题中的基本现象,反映了重建质量与视觉感知之间的内在矛盾。在推理时灵活调节该权衡对实际应用至关重要。尽管扩散模型在零样本逆问题求解中取得成功,但基于扩散模型的逆算法中高效且有理论依据的D-P权衡策略仍不充分。本文提出一种分阶段框架(MAP-RPS),仅用一个扩散模型即可实现零样本逆问题中的D-P权衡。方法首先通过最大后验(MAP)估计阶段逼近最小均方误差(MMSE)解,提供低失真初始化;随后进入重去噪后验采样阶段,逐步提升感知质量。我们为两阶段提供了理论分析,验证了设计的有效性。进一步地,将方法扩展至潜在空间,得到LMAP-RPS,利用大规模预训练潜在扩散模型实现更广适用性。大量实验表明,MAP-RPS和LMAP-RPS在多个任务中实现了更优的D-P权衡,同时作为高效求解器在真实逆问题中表现优异。

原文摘要 · Abstract (English)

The distortion-perception (D-P) tradeoff is a fundamental phenomenon of Bayesian inverse problems, which characterizes the inherent tension between distortion performance and perceptual quality. Enabling flexible traversal of the D-P tradeoff at inference time is crucial for practical applications. Despite the recent success of diffusion models in zero-shot inverse problem solving, efficient and principled strategies for D-P traversal in diffusion-based inverse algorithms remain inadequately characterized. In this paper, we propose a stage-wise framework for realizing D-P traversal using a single diffusion model in zero-shot inverse problems. Our proposed method, termed MAP-RPS, starts with an MAP estimation stage that approximates the MMSE solution and provides a low-distortion initialization, followed by a re-noised posterior sampling stage that progressively improves perceptual quality. We provide theoretical analyses for both stages, establishing the validity and effectiveness of the proposed design. Furthermore, we extend MAP-RPS to the latent space, yielding LMAP-RPS, which enjoys broader applicability by leveraging large-scale pre-trained latent diffusion backbones. Extensive experiments demonstrate that MAP-RPS and LMAP-RPS enable more effective D-P traversal on various tasks, while also exhibiting strong performance as efficient solvers for real-world inverse problems.

扩散模型逆问题感知质量零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。