arXiv:2512.16303cs.CVcs.AI2025-12

用像素级分割评估多模态模型的视觉智能,发现Gemini新模型零样本生成精度惊人。

PixelArena: A benchmark for Pixel-Precision Visual Intelligence

  • 以语义分割任务为基准,实现像素级客观评估生成能力
  • Gemini 3 Pro Image 零样本生成高保真语义掩码,展现前所未有的视觉智能
  • 揭示模型缺陷并推动数据集与评测方法优化,适合研究多模态生成的学者

多模态模型在输入输出上呈现多样化趋势,但图像生成等任务的评估因人类偏好细微差异和模型偏差而困难。现有基准多关注美学而非细粒度生成能力,缺乏客观指标。本文提出PixelArena基准,通过语义分割任务以像素精度客观评估模型的细粒度生成智能。实验发现,最新Gemini 3 Pro Image在零样本设置下生成的语义掩码具有高保真度,展现出此前未见的视觉智能与真正泛化能力。进一步对比分析其他模型结果,揭示失败案例。研究不仅标志领域重要进展,也为数据集构建、多模态模型开发及评测指标设计提供洞见。

原文摘要 · Abstract (English)

Omni-modal models that have multimodal input and output are emerging. However, benchmarking their multimodal generation, especially in image generation, is challenging due to the subtleties of human preferences and model biases. Many image generation benchmarks focus on aesthetics instead of the fine-grained generation capabilities of these models, failing to evaluate their visual intelligence with objective metrics. In PixelArena, we propose using semantic segmentation tasks to objectively examine their fine-grained generative intelligence with pixel precision. With our benchmark and experiments, we find the latest Gemini 3 Pro Image has emergent image generation capabilities that generate semantic masks with high fidelity under zero-shot settings, showcasing visual intelligence unseen before and true generalization in new image generation tasks. We further investigate its results, compare them qualitatively and quantitatively with those of other models, and present failure cases. The findings not only signal exciting progress in the field but also provide insights into future research related to dataset development, omni-modal model development, and the design of metrics.

多模态视觉智能生成评估像素级

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。