arXiv:2505.14460cs.CV2025-05NeurIPS被引 86

用强化学习让模型学会判断图像质量,更像人一样思考。

VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rank

  • 通过强化学习排名机制,让模型比较图像质量高低。
  • 在多个数据集上优于现有方法,尤其擅长超分辨率与生成任务。
  • 能生成符合人类认知的详细质量描述,适合复杂图像处理评估。

深度推理模型DeepSeek-R1在激励大语言模型的推理与泛化能力方面表现优异。然而,视觉推理在无参考图像质量评估(NR-IQA)中的潜力尚未充分挖掘,而该任务高度依赖视觉推理能力。本文提出VisualQuality-R1,一种基于强化学习排序的推理驱动型无参考图像质量评估模型。针对一对图像,采用分组相对策略优化生成多个质量评分,基于Thurstone模型计算一图优于另一图的相对概率。奖励设计采用连续保真度度量,而非离散二分类标签。大量实验表明,VisualQuality-R1持续优于基于判别式深度学习的NR-IQA模型及近期推理驱动的质量回归方法。此外,该模型可生成上下文丰富的、与人类感知一致的质量描述,并支持多数据集训练而无需感知尺度重校准。这些特性使其特别适用于超分辨率、图像生成等广泛图像处理任务中对性能提升的可靠评估。

原文摘要 · Abstract (English)

DeepSeek-R1 has demonstrated remarkable effectiveness in incentivizing reasoning and generalization capabilities of large language models (LLMs) through reinforcement learning. Nevertheless, the potential of reasoning-induced computation has not been thoroughly explored in the context of image quality assessment (IQA), a task depending critically on visual reasoning. In this paper, we introduce VisualQuality-R1, a reasoning-induced no-reference IQA (NR-IQA) model, and we train it with reinforcement learning to rank, a learning algorithm tailored to the intrinsically relative nature of visual quality. Specifically, for a pair of images, we employ group relative policy optimization to generate multiple quality scores for each image. These estimates are used to compute comparative probabilities of one image having higher quality than the other under the Thurstone model. Rewards for each quality estimate are defined using continuous fidelity measures rather than discretized binary labels. Extensive experiments show that the proposed VisualQuality-R1 consistently outperforms discriminative deep learning-based NR-IQA models as well as a recent reasoning-induced quality regression method. Moreover, VisualQuality-R1 is capable of generating contextually rich, human-aligned quality descriptions, and supports multi-dataset training without requiring perceptual scale realignment. These features make VisualQuality-R1 especially well-suited for reliably measuring progress in a wide range of image processing tasks like super-resolution and image generation.

图像质量评估强化学习大模型无参考

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。