arXiv:2603.09326cs.CV2026-03中稿 · CVPR被引 3

测试大模型对细微视觉差异的感知能力,发现表现远低于人类。

OddGridBench: Exposing the Lack of Fine-Grained Visual Discrepancy Sensitivity in Multimodal Large Language Models

  • 构建网格图像基准,单个元素在颜色/位置等属性上微调差异。
  • 所有测试模型准确率均远低于人类,最高仅达42.3%。
  • 提出新强化学习框架,通过渐进难度和空间距离奖励提升感知力。

多模态大语言模型在多种视觉语言任务中表现优异,但在低层视觉感知,尤其是精细视觉差异检测方面仍缺乏系统研究。本文提出OddGridBench,一个可控制的基准,用于评估多模态大模型的视觉差异敏感度。该基准包含超过1,400张基于网格的图像,其中单一元素在颜色、大小、旋转或位置等一个或多个视觉属性上与其余元素存在差异。实验表明,所有测试模型(包括Qwen3-VL、InternVL3.5、Gemini-2.5-Pro和GPT-5)在视觉差异检测上的表现远低于人类水平,最高准确率为42.3%。为此,我们进一步提出OddGrid-GRPO,一种结合课程学习与距离感知奖励的强化学习框架。通过逐步控制训练样本难度,并在奖励设计中引入空间邻近性约束,OddGrid-GRPO显著提升了模型的细粒度视觉区分能力。我们希望OddGridBench与OddGrid-GRPO能为多模态智能中的感知对齐与视觉敏感度研究奠定基础。代码与数据集见https://wwwtttjjj.github.io/OddGridBench/。

原文摘要 · Abstract (English)

Multimodal large language models (MLLMs) have achieved remarkable performance across a wide range of vision language tasks. However, their ability in low-level visual perception, particularly in detecting fine-grained visual discrepancies, remains underexplored and lacks systematic analysis. In this work, we introduce OddGridBench, a controllable benchmark for evaluating the visual discrepancy sensitivity of MLLMs. OddGridBench comprises over 1,400 grid-based images, where a single element differs from all others by one or multiple visual attributes such as color, size, rotation, or position. Experiments reveal that all evaluated MLLMs, including open-source families such as Qwen3-VL and InternVL3.5, and proprietary systems like Gemini-2.5-Pro and GPT-5, perform far below human levels in visual discrepancy detection. We further propose OddGrid-GRPO, a reinforcement learning framework that integrates curriculum learning and distance-aware reward. By progressively controlling the difficulty of training samples and incorporating spatial proximity constraints into the reward design, OddGrid-GRPO significantly enhances the model's fine-grained visual discrimination ability. We hope OddGridBench and OddGrid-GRPO will lay the groundwork for advancing perceptual grounding and visual discrepancy sensitivity in multimodal intelligence. Code and dataset are available at https://wwwtttjjj.github.io/OddGridBench/.

多模态视觉感知大模型评测强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。