arXiv:2512.22780cs.CVeess.IV2025-12被引 1

用心理测量学改进图像质量评估,解决文本描述与图像匹配不一致问题。

Plug In, Grade Right: Psychology-Inspired AGIQA

  • 借鉴心理测量模型,构建双分支质量评分模块,分离图像能力与难度等级。
  • 通过算术方式建模难度,使质量分布呈单峰可解释形态,提升评估可靠性。
  • 可插拔集成到多种主流模型中,适用于自然图像与屏幕内容质量评估。

现有AGIQA模型通常通过计算图像嵌入与多级质量描述文本嵌入之间的相似性来估计图像质量。尽管有效,我们观察到这些相似性分布常呈现多峰特性:例如,图像嵌入可能同时与‘优秀’和‘差’的描述高度相似,而偏离‘良好’描述。我们称此现象为‘语义漂移’,即文本嵌入与其目标描述间的语义不一致,削弱了图文共享空间学习的可靠性。为此,我们受心理测量学启发,提出改进的分级反应模型(GRM)。该模型将图像质量视为图像满足各等级的能力,与人类质量评分机制高度契合。我们设计了一个双分支质量评分模块:一枝估计图像能力,另一枝构建多个难度等级。为保证难度等级单调性,采用算术方式生成难度,天然实现单峰且可解释的质量分布。基于算术GRM的品质评分模块(AGQG)具有即插即用优势,在多种先进AGIQA框架中持续提升性能,且在自然图像与屏幕内容图像质量评估上均表现良好,展现出作为未来IQA核心组件的潜力。

原文摘要 · Abstract (English)

Existing AGIQA models typically estimate image quality by measuring and aggregating the similarities between image embeddings and text embeddings derived from multi-grade quality descriptions. Although effective, we observe that such similarity distributions across grades usually exhibit multimodal patterns. For instance, an image embedding may show high similarity to both "excellent" and "poor" grade descriptions while deviating from the "good" one. We refer to this phenomenon as "semantic drift", where semantic inconsistencies between text embeddings and their intended descriptions undermine the reliability of text-image shared-space learning. To mitigate this issue, we draw inspiration from psychometrics and propose an improved Graded Response Model (GRM) for AGIQA. The GRM is a classical assessment model that categorizes a subject's ability across grades using test items with various difficulty levels. This paradigm aligns remarkably well with human quality rating, where image quality can be interpreted as an image's ability to meet various quality grades. Building on this philosophy, we design a two-branch quality grading module: one branch estimates image ability while the other constructs multiple difficulty levels. To ensure monotonicity in difficulty levels, we further model difficulty generation in an arithmetic manner, which inherently enforces a unimodal and interpretable quality distribution. Our Arithmetic GRM based Quality Grading (AGQG) module enjoys a plug-and-play advantage, consistently improving performance when integrated into various state-of-the-art AGIQA frameworks. Moreover, it also generalizes effectively to both natural and screen content image quality assessment, revealing its potential as a key component in future IQA models.

图像质量评估心理测量多模态可插拔

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。