arXiv:2505.16314cs.CVcs.AI2025-05CVPR被引 25

评测文生图模型的图文对齐与结构失真,推动高质量生成评估标准

NTIRE 2025 challenge on Text to Image Generation Model Quality Assessment

  • 分图文对齐与结构失真两赛道,使用EvalMuse数据集进行量化评估
  • 共收1883次开发提交,507次测试提交,最终12队胜出
  • 参赛方法普遍优于基线,冠军方案在质量预测上表现最优

本文报告了将在CVPR 2025 NTIRE Workshop期间举办的NTIRE 2025文生图模型质量评估挑战赛。该挑战聚焦于文生图模型的细粒度质量评估,涵盖图文对齐与图像结构失真检测两个维度,分为对齐赛道与结构赛道。对齐赛道使用包含约4万张由20个主流生成模型产生的AI生成图像(AIGIs)的EvalMuse-40K数据集,共有371名参与者注册,开发阶段收到1,883次提交,测试阶段507次,最终12支队伍提交模型与说明文档。结构赛道采用包含1万张带有结构失真掩码的AI生成图像(AIGIs)的EvalMuse-Structure数据集,211人注册,开发阶段1,155次提交,测试阶段487次,最终8支队伍完成提交。几乎所有方法均优于基线,两赛道冠军方法在文生图模型质量评估上表现出卓越预测性能。

原文摘要 · Abstract (English)

This paper reports on the NTIRE 2025 challenge on Text to Image (T2I) generation model quality assessment, which will be held in conjunction with the New Trends in Image Restoration and Enhancement Workshop (NTIRE) at CVPR 2025. The aim of this challenge is to address the fine-grained quality assessment of text-to-image generation models. This challenge evaluates text-to-image models from two aspects: image-text alignment and image structural distortion detection, and is divided into the alignment track and the structural track. The alignment track uses the EvalMuse-40K, which contains around 40K AI-Generated Images (AIGIs) generated by 20 popular generative models. The alignment track has a total of 371 registered participants. A total of 1,883 submissions are received in the development phase, and 507 submissions are received in the test phase. Finally, 12 participating teams submitted their models and fact sheets. The structure track uses the EvalMuse-Structure, which contains 10,000 AI-Generated Images (AIGIs) with corresponding structural distortion mask. A total of 211 participants have registered in the structure track. A total of 1155 submissions are received in the development phase, and 487 submissions are received in the test phase. Finally, 8 participating teams submitted their models and fact sheets. Almost all methods have achieved better results than baseline methods, and the winning methods in both tracks have demonstrated superior prediction performance on T2I model quality assessment.

文生图质量评估挑战赛图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。