arXiv:2604.11004cs.CVcs.AI2026-04中稿 · ICLR

用结构化图表示图像对差异,实现细粒度质量评估

Panoptic Pairwise Distortion Graph

论文配图:Panoptic Pairwise Distortion Graph
图 1 · 摘自论文原文
  • 将图像对建模为基于区域的结构化拓扑图,捕捉局部退化信息
  • 在PandaBench上,主流多模态大模型仍无法理解区域级退化
  • 新数据集与架构使模型具备区域级退化感知能力,适合图像质量评估研究者

本文提出一种新的图像对比评估视角,将图像对表示为区域构成的结构化组合。现有方法聚焦整体图像分析,隐含依赖区域理解。我们扩展场景图概念至跨图像层面,引入新的畸变图(Distortion Graph, DG)任务:将图像对建模为以区域为基础的结构化拓扑,紧凑可解释地表示畸变类型、严重程度、比较关系及质量评分等密集退化信息。为实现该任务,我们构建了(i)区域级数据集PandaSet,(ii)具有不同区域难度的基准套件PandaBench,以及(iii)高效生成畸变图的Panda架构。实验表明,即使提供明确区域提示,当前先进多模态大语言模型在PandaBench上仍无法理解区域级退化;而使用PandaSet训练或引入DG提示,可有效激发模型对区域退化的理解,开辟细粒度、结构化图像对评估的新方向。

原文摘要 · Abstract (English)

In this work, we introduce a new perspective on comparative image assessment by representing an image pair as a structured composition of its regions. In contrast, existing methods focus on whole image analysis, while implicitly relying on region-level understanding. We extend the intra-image notion of a scene graph to inter-image, and propose a novel task of Distortion Graph (DG). DG treats paired images as a structured topology grounded in regions, and represents dense degradation information such as distortion type, severity, comparison and quality score in a compact interpretable graph structure. To realize the task of learning a distortion graph, we contribute (i) a region-level dataset, PandaSet, (ii) a benchmark suite, PandaBench, with varying region-level difficulty, and (iii) an efficient architecture, Panda, to generate distortion graphs. We demonstrate that PandaBench poses a significant challenge for state-of-the-art multimodal large language models (MLLMs) as they fail to understand region-level degradations even when fed with explicit region cues. We show that training on PandaSet or prompting with DG elicits region-wise distortion understanding, opening a new direction for fine-grained, structured pairwise image assessment.

图像评估结构化图区域理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。