arXiv:2506.00327cs.CVcs.AI2025-06ICML被引 3

用扩散模型隐空间引导感知评估,提升无参考图像质量判别能力

Latent Guidance in Diffusion Models for Perceptual Evaluations

  • 利用预训练扩散模型的隐空间特征,结合感知质量信号指导采样
  • 在多个图像质量数据集上达到当前最优表现,相关性接近人类判断
  • 可无缝集成到任意现有扩散模型,适合图像质量评估研究者

尽管潜空间扩散模型在生成高维图像数据和执行多种下游任务方面取得进展,但其在无参考图像质量评估(NR-IQA)任务中对感知一致性的探索仍不足。本文假设潜空间扩散模型在数据流形上存在隐含的感知一致性局部区域,并据此提出感知流形引导(PMG)算法,利用预训练潜空间扩散模型与感知质量特征,从去噪U-Net中获取多尺度、多时间步的感知一致特征图。实验表明,这些超特征在图像质量评估任务中与人类感知高度相关。所提方法LGDM可适配任意现有预训练潜空间扩散模型,实现简单集成。据我们所知,这是首个将感知特征用于引导扩散模型进行NR-IQA的研究。在多个IQA数据集上的大量实验显示,该方法达到当前最优性能,验证了扩散模型在NR-IQA任务中的卓越泛化能力。

原文摘要 · Abstract (English)

Despite recent advancements in latent diffusion models that generate high-dimensional image data and perform various downstream tasks, there has been little exploration into perceptual consistency within these models on the task of No-Reference Image Quality Assessment (NR-IQA). In this paper, we hypothesize that latent diffusion models implicitly exhibit perceptually consistent local regions within the data manifold. We leverage this insight to guide on-manifold sampling using perceptual features and input measurements. Specifically, we propose Perceptual Manifold Guidance (PMG), an algorithm that utilizes pretrained latent diffusion models and perceptual quality features to obtain perceptually consistent multi-scale and multi-timestep feature maps from the denoising U-Net. We empirically demonstrate that these hyperfeatures exhibit high correlation with human perception in IQA tasks. Our method can be applied to any existing pretrained latent diffusion model and is straightforward to integrate. To the best of our knowledge, this paper is the first work on guiding diffusion model with perceptual features for NR-IQA. Extensive experiments on IQA datasets show that our method, LGDM, achieves state-of-the-art performance, underscoring the superior generalization capabilities of diffusion models for NR-IQA tasks.

扩散模型图像质量感知评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。