arXiv:2503.20297cs.CV2025-03CVPR被引 7

用一个模型灵活切换图像去噪的清晰度与保真度

Traversing Distortion-Perception Tradeoff using a Single Score-Based Generative Model

  • 通过变率缩放反向扩散过程,统一建模去噪不同需求
  • 单个预训练模型即可在失真-感知权衡曲线上任意点生成结果
  • 适合需要快速适配不同去噪目标的研究者和开发者

失真-感知(DP)权衡揭示了失真度量(如MSE、PSNR)与感知质量之间的根本矛盾。近年来研究聚焦于在DP框架下评估去噪算法,但现有方法或偏重感知质量而牺牲可接受的失真,或仅追求最小化MSE以实现忠实重建。当目标变化或噪声测量不同,需重新训练甚至重构模型。受基于得分的生成模型解决逆问题进展的启发,我们探索使用单一预训练得分模型灵活且最优地遍历DP权衡。具体提出一种方差缩放的反向扩散过程,并理论刻画其边缘分布。证明该采样过程是条件高斯分布下DP权衡的最优解。在二维数据与图像数据集上的实验表明,单一得分网络能有效且灵活地应对通用去噪问题中的DP权衡。

原文摘要 · Abstract (English)

The distortion-perception (DP) tradeoff reveals a fundamental conflict between distortion metrics (e.g., MSE and PSNR) and perceptual quality. Recent research has increasingly concentrated on evaluating denoising algorithms within the DP framework. However, existing algorithms either prioritize perceptual quality by sacrificing acceptable distortion, or focus on minimizing MSE for faithful restoration. When the goal shifts or noisy measurements vary, adapting to different points on the DP plane needs retraining or even re-designing the model. Inspired by recent advances in solving inverse problems using score-based generative models, we explore the potential of flexibly and optimally traversing DP tradeoffs using a single pre-trained score-based model. Specifically, we introduce a variance-scaled reverse diffusion process and theoretically characterize the marginal distribution. We then prove that the proposed sample process is an optimal solution to the DP tradeoff for conditional Gaussian distribution. Experimental results on two-dimensional and image datasets illustrate that a single score network can effectively and flexibly traverse the DP tradeoff for general denoising problems.

去噪得分模型生成模型权衡优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。