arXiv:2601.22920cs.CV2026-01被引 4

提升图像质量评估的可靠性,通过动态加权和视觉感知约束优化强化学习模型。

Q-Hawkeye: Reliable Visual Policy Optimization for Image Quality Assessment

  • 基于多轮采样方差估计预测不确定性,动态调整样本更新强度。
  • 在多个数据集上超越现有方法,尤其在跨域泛化性能更优。
  • 适合需要高可靠性的图像质量评估场景,如医疗影像与自动驾驶。

图像质量评估(IQA)旨在预测与人类判断一致的感知质量分数。近期基于强化学习的IQA方法虽利用多模态大模型生成视觉质量描述与评分,却忽视了两个关键可靠性问题:(i) 模型在不同训练样本上的预测稳定性差异显著,而现有基于GRPO的方法采用统一的优势权重,导致不稳定样本的噪声信号在梯度更新中被放大;(ii) 多数工作强调文本引导推理,忽略模型对图像内容的真实视觉感知能力。本文提出Q-Hawkeye,一种基于强化学习的可靠视觉策略优化框架,通过统一的不确定性感知动态优化与感知意识优化重构学习信号。Q-Hawkeye利用多次采样下预测分数的方差估计预测不确定性,并据此重加权各样本的更新强度,稳定策略优化过程。为增强感知可靠性,构建退化图像与其原始图像的配对输入,引入隐式感知损失,强制模型基于真实的视觉证据进行质量判断。大量实验表明,Q-Hawkeye优于当前最优方法,并在多个数据集上展现出更强的泛化能力。代码与数据集已开源于https://github.com/AMAP-ML/Q-Hawkeye。

原文摘要 · Abstract (English)

Image Quality Assessment (IQA) predicts perceptual quality scores consistent with human judgments. Recent RL-based IQA methods built on MLLMs focus on generating visual quality descriptions and scores, ignoring two key reliability limitations: (i) although the model's prediction stability varies significantly across training samples, existing GRPO-based methods apply uniform advantage weighting, thereby amplifying noisy signals from unstable samples in gradient updates; (ii) most works emphasize text-grounded reasoning over images while overlooking the model's visual perception ability of image content. In this paper, we propose Q-Hawkeye, an RL-based reliable visual policy optimization framework that redesigns the learning signal through unified Uncertainty-Aware Dynamic Optimization and Perception-Aware Optimization. Q-Hawkeye estimates predictive uncertainty using the variance of predicted scores across multiple rollouts and leverages this uncertainty to reweight each sample's update strength, stabilizing policy optimization. To strengthen perceptual reliability, we construct paired inputs of degraded images and their original images and introduce an Implicit Perception Loss that constrains the model to ground its quality judgments in genuine visual evidence. Extensive experiments demonstrate that Q-Hawkeye outperforms state-of-the-art methods and generalizes better across multiple datasets. Our dataset and code are available at https://github.com/AMAP-ML/Q-Hawkeye.

图像质量强化学习视觉感知可靠性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。