统一训练框架让视觉质量评估兼具准确与可解释。
Q-Ponder: A Unified Training Pipeline for Reasoning-based Visual Quality Assessment
- 分两阶段训练:先用提示蒸馏初始化推理能力,再用强化学习联合优化评分与推理一致性。
- 在跨域数据集上评分相关性提升6.5%,超越现有最优模型。
- 适合需要高可信度评估结果的研究者或工业应用。
近期研究表明,多模态大语言模型(MLLMs)可通过可解释的推理评估视觉质量。然而,现有方法通常将评分与推理描述视为独立任务,优化目标分离,导致擅长推理的模型评分不准,专注评分的模型缺乏可解释性。为此,我们提出统一的两阶段训练框架:第一阶段通过专家设计提示从教师模型蒸馏高质量数据,利用交叉熵损失初始化推理能力;第二阶段引入新型奖励机制与组相对策略优化(GRPO),联合优化评分准确性与推理一致性。由此得到的Q-Ponder-CI与Q-Ponder模型在多个质量评分基准上达到当前最优(SOTA)表现,跨域数据集上皮尔逊相关系数(SRCC)最高提升6.5%。Q-Ponder显著优于基于描述的SOTA模型,包括其教师模型Qwen-2.5-VL-72B,尤其在描述准确性和合理性方面表现突出,展现出对多样化任务的强大泛化能力。
原文摘要 · Abstract (English)
Recent studies demonstrate that multimodal large language models (MLLMs) can proficiently evaluate visual quality through interpretable assessments. However, existing approaches typically treat quality scoring and reasoning descriptions as separate tasks with disjoint optimization objectives, leading to a trade-off: models adept at quality reasoning descriptions struggle with precise score regression, while score-focused models lack interpretability. This limitation hinders the full potential of MLLMs in visual quality assessment, where accuracy and interpretability should be mutually reinforcing. To address this, we propose a unified two-stage training framework comprising a cold-start stage and a reinforcement learning-based fine-tuning stage. Specifically, in the first stage, we distill high-quality data from a teacher model through expert-designed prompts, initializing reasoning capabilities via cross-entropy loss supervision. In the second stage, we introduce a novel reward with Group Relative Policy Optimization (GRPO) to jointly optimize scoring accuracy and reasoning consistency. We designate the models derived from these two stages as Q-Ponder-CI and Q-Ponder. Extensive experiments show that Q-Ponder achieves state-of-the-art (SOTA) performance on quality score regression benchmarks, delivering up to 6.5% higher SRCC on cross-domain datasets. Furthermore, Q-Ponder significantly outperforms description-based SOTA models, including its teacher model Qwen-2.5-VL-72B, particularly in description accuracy and reasonableness, demonstrating the generalization potential over diverse tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。