无需人工标注,让视觉语言模型自进化提升图像质量评估能力
Self-Evolving Vision-Language Models for Image Quality Assessment via Voting and Ranking
- 用模型自身输出做投票生成伪排名,构建自监督学习信号
- 在多个数据集上零样本性能提升31.8%(PLCC),媲美甚至超越有监督模型
- 适合追求低成本、高泛化能力的图像质量评估研究者
现有视觉语言模型(VLM)在后训练阶段通常依赖昂贵的人工标注数据进行微调或强化学习。尽管自监督方法在推理能力提升中表现有效,但在图像质量评估(IQA)这类感知任务中的应用仍不充分。本文提出EvoQuality框架,使VLM无需任何真实标签即可自主优化其感知能力。该框架将自一致性原则应用于基于排序的IQA任务:通过模型自身输出的成对多数投票生成伪排名,形成保真度奖励信号,并结合群体相对策略优化(GRPO)实现迭代演化。实验表明,EvoQuality在多个IQA基准上使基础VLM的零样本性能提升31.8%(PLCC)。值得注意的是,完全自监督的EvoQuality在7个基准中5个超过当前最优有监督模型,且可与预训练IQA模型堆叠以增强对未见数据集的泛化能力。代码与模型权重将公开于https://github.com/bytedance/EvoQuality。
原文摘要 · Abstract (English)
Improving vision-language models (VLMs) in the post-training stage typically relies on supervised fine-tuning or reinforcement learning, methods that necessitate costly, human-annotated data. While self-supervised techniques have proven effective for enhancing reasoning capabilities, their application to perceptual domains such as image quality assessment (IQA) remains largely unexplored. In this work, we introduce EvoQuality, a novel framework that enables a VLM to autonomously refine its quality perception capabilities without any ground-truth labels. EvoQuality adapts the principle of self-consistency to the ranking-based nature of IQA. It generates pseudo-labels by performing pairwise majority voting on the VLM's own outputs to establish a consensus on relative quality. These pseudo-rankings are then formulated into a fidelity reward that guides the model's iterative evolution through group relative policy optimization (GRPO). By iteratively leveraging its own predictions, EvoQuality progressively refines the VLM's perceptual capability. Extensive experiments show that EvoQuality boosts the base VLM's zero-shot performance by 31.8% on PLCC across diverse IQA benchmarks. Remarkably, despite being entirely self-supervised, EvoQuality achieves performance that is competitive with, or even surpasses, state-of-the-art supervised VLM-based IQA models, outperforming these models on 5 out of 7 IQA benchmarks. Furthermore, the framework demonstrates significant flexibility, allowing it to be stacked with pre-trained IQA models to bolster generalization on unseen datasets. Codes and checkpoints will be available at https://github.com/bytedance/EvoQuality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。