用强化学习让AI看图懂质量,少标注也能精准判断图像好坏。
Q-Insight: Understanding Image Quality via Visual Reinforcement Learning
- 基于强化学习设计奖励机制,联合优化评分与退化感知。
- 仅需少量标注数据,在多个任务上超越现有方法。
- 零样本泛化强,适合需要解释性的图像质量分析场景。
图像质量评估(IQA)关注图像的感知质量,在图像重建、压缩和生成等下游任务中至关重要。多模态大模型的发展使IQA迈向更全面的理解,涵盖内容分析、退化感知与对比推理,而不仅限于数值评分。以往基于多模态大模型的方法或仅输出不可解释的分数,或严重依赖大规模标注数据进行监督微调,限制了灵活性与适用性。本文提出Q-Insight,一种基于组相对策略优化(GRPO)的强化学习模型,仅需少量评分与退化标签,即可实现强大的视觉推理能力。通过精心设计的奖励函数联合优化评分回归与退化感知任务,有效利用二者互惠优势。大量实验表明,Q-Insight在评分回归与退化感知任务中显著优于现有先进方法,并展现出出色的零样本泛化能力,适用于对比推理任务。代码将开源于 https://github.com/lwq20020127/Q-Insight。
原文摘要 · Abstract (English)
Image quality assessment (IQA) focuses on the perceptual visual quality of images, playing a crucial role in downstream tasks such as image reconstruction, compression, and generation. The rapid advancement of multi-modal large language models (MLLMs) has significantly broadened the scope of IQA, moving toward comprehensive image quality understanding that incorporates content analysis, degradation perception, and comparison reasoning beyond mere numerical scoring. Previous MLLM-based methods typically either generate numerical scores lacking interpretability or heavily rely on supervised fine-tuning (SFT) using large-scale annotated datasets to provide descriptive assessments, limiting their flexibility and applicability. In this paper, we propose Q-Insight, a reinforcement learning-based model built upon group relative policy optimization (GRPO), which demonstrates strong visual reasoning capability for image quality understanding while requiring only a limited amount of rating scores and degradation labels. By jointly optimizing score regression and degradation perception tasks with carefully designed reward functions, our approach effectively exploits their mutual benefits for enhanced performance. Extensive experiments demonstrate that Q-Insight substantially outperforms existing state-of-the-art methods in both score regression and degradation perception tasks, while exhibiting impressive zero-shot generalization to comparison reasoning tasks. Code will be available at https://github.com/lwq20020127/Q-Insight.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。