用大模型评估高质量图片差异,还能说出专业理由。
NTIRE 2026 The 3rd Restore Any Image Model (RAIM) Challenge: Professional Image Quality Assessment (Track 1)
- 用多模态大模型对比高质图像优劣,模拟专家判断。
- 参赛者需准确选优并给出有依据的解释,超越单一评分。
- 适合研究AI视觉评估、人机协作的开发者与研究者。
本文介绍NTIRE 2026年第3届‘任意图像修复模型’挑战赛中针对专业图像质量评估(Track 1)的评测任务。传统图像质量评估(IQA)依赖单一数值评分,难以区分高质量图像间的细微差异,且缺乏解释能力,无法为视觉任务提供指导。为此,我们基于多模态大语言模型(MLLMs)构建新基准,探索其模拟人类专家认知评估高质图像对的能力。参赛任务聚焦两大目标:(1) 比较质量选择——可靠识别高质量图像对中的更优者;(2) 解释性推理——生成基于事实的专家级解释。挑战共吸引近200名注册者,提交超2500份结果。顶尖方法显著提升专业IQA性能。数据集已公开于https://github.com/narthchin/RAIM-PIQA,官方主页为https://www.codabench.org/competitions/12789/。
原文摘要 · Abstract (English)
In this paper, we present an overview of the NTIRE 2026 challenge on the 3rd Restore Any Image Model in the Wild, specifically focusing on Track 1: Professional Image Quality Assessment. Conventional Image Quality Assessment (IQA) typically relies on scalar scores. By compressing complex visual characteristics into a single number, these methods fundamentally struggle to distinguish subtle differences among uniformly high-quality images. Furthermore, they fail to articulate why one image is superior, lacking the reasoning capabilities required to provide guidance for vision tasks. To bridge this gap, recent advancements in Multimodal Large Language Models (MLLMs) offer a promising paradigm. Inspired by this potential, our challenge establishes a novel benchmark exploring the ability of MLLMs to mimic human expert cognition in evaluating high-quality image pairs. Participants were tasked with overcoming critical bottlenecks in professional scenarios, centering on two primary objectives: (1) Comparative Quality Selection: reliably identifying the visually superior image within a high-quality pair; and (2) Interpretative Reasoning: generating grounded, expert-level explanations that detail the rationale behind the selection. In total, the challenge attracted nearly 200 registrations and over 2,500 submissions. The top-performing methods significantly advanced the state of the art in professional IQA. The challenge dataset is available at https://github.com/narthchin/RAIM-PIQA, and the official homepage is accessible at https://www.codabench.org/competitions/12789/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。