arXiv:2601.21738cs.CVcs.AI2026-01TPAMI被引 3

用三维相关图揭示图像质量评估模型在不同质量区间的表现差异

From Global to Granular: Revealing IQA Model Performance via Correlation Surface

  • 提出分粒度相关分析方法,按图像质量均值和差异加权计算局部相关性
  • 在多个数据集上验证,相同排名相关系数的模型表现可能完全不同
  • 适合需要精细评估模型性能的研究者和实际部署场景

图像质量评估(IQA)模型的评价长期依赖于皮尔逊线性相关系数(PLCC)和斯皮尔曼等级相关系数(SRCC)等全局指标。这些指标将性能压缩为单一数值,无法捕捉排序一致性在局部质量范围内的变化。例如,两个IQA模型可能具有相同的SRCC值,但一个在高质量图像(高均值意见评分,MOS)上更稳定,另一个在小质量差异(|ΔMOS|)图像对上区分能力更强。这种互补行为在全局指标下不可见。此外,SRCC和PLCC对测试样本的质量分布敏感,导致跨数据集比较不稳定。为此,本文提出分粒度调制相关(GMC),提供结构化、细粒度的IQA性能分析。GMC包括:(1) 分粒度调制器,基于绝对MOS值和成对MOS差值(|ΔMOS|)进行高斯加权相关计算,以分析局部性能变化;(2) 分布调节器,通过正则化降低非均匀质量分布带来的偏差。由此产生的相关表面将相关值作为MOS与|ΔMOS|的联合函数进行映射,形成3D性能视图。标准基准实验表明,GMC揭示了标量指标无法捕捉的性能特征,提供了更全面、可靠的IQA模型分析、比较与部署范式。代码已开源。

原文摘要 · Abstract (English)

Evaluation of Image Quality Assessment (IQA) models has long been dominated by global correlation metrics, such as Pearson Linear Correlation Coefficient (PLCC) and Spearman Rank-Order Correlation Coefficient (SRCC). While widely adopted, these metrics reduce performance to a single scalar, failing to capture how ranking consistency varies across the local quality spectrum. For example, two IQA models may achieve identical SRCC values, yet one ranks high-quality images (related to high Mean Opinion Score, MOS) more reliably, while the other better discriminates image pairs with small quality/MOS differences (related to $|Δ$MOS$|$). Such complementary behaviors are invisible under global metrics. Moreover, SRCC and PLCC are sensitive to test-sample quality distributions, yielding unstable comparisons across test sets. To address these limitations, we propose \textbf{Granularity-Modulated Correlation (GMC)}, which provides a structured, fine-grained analysis of IQA performance. GMC includes: (1) a \textbf{Granularity Modulator} that applies Gaussian-weighted correlations conditioned on absolute MOS values and pairwise MOS differences ($|Δ$MOS$|$) to examine local performance variations, and (2) a \textbf{Distribution Regulator} that regularizes correlations to mitigate biases from non-uniform quality distributions. The resulting \textbf{correlation surface} maps correlation values as a joint function of MOS and $|Δ$MOS$|$, providing a 3D representation of IQA performance. Experiments on standard benchmarks show that GMC reveals performance characteristics invisible to scalar metrics, offering a more informative and reliable paradigm for analyzing, comparing, and deploying IQA models. Codes are available at https://github.com/Dniaaa/GMC.

图像质量评估相关分析性能评估3D可视化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。