针对AI生成图像的视觉质量与文本对齐度,提出分任务提示与多粒度相似性评估方法。
AI-Generated Image Quality Assessment Based on Task-Specific Prompt and Multi-Granularity Similarity
- 为感知和对齐任务设计专用提示,区分评估目标
- 在AGIQA-1K和AGIQA-3K上优于现有方法
- 适合改进生成模型质量评估与优化
近期由给定提示生成的AI生成图像(AIGIs)引发广泛关注。然而,由于技术局限,常出现感知质量差和图文不一致问题。因此,评估AIGIs的感知质量与对齐质量对提升生成模型性能至关重要。现有评估方法过度依赖初始提示进行任务设计,并用同一提示同时指导感知与对齐评估,忽视了两者的差异。为此,我们提出一种新型质量评估方法TSP-MGS,通过设计任务专用提示并测量图像与提示之间的多粒度相似性。具体地,分别构建描述感知与对齐质量程度的任务专用提示,并引入初始提示以实现细节感知;计算图像与任务提示间的粗粒度相似性,实现整体质量感知;进一步测量图像与初始提示间的细粒度相似性以增强细节理解;最终融合多粒度相似性实现精准质量预测。在常用基准AGIQA-1K和AGIQA-3K上的实验表明,所提TSP-MGS具有显著优势。
原文摘要 · Abstract (English)
Recently, AI-generated images (AIGIs) created by given prompts (initial prompts) have garnered widespread attention. Nevertheless, due to technical nonproficiency, they often suffer from poor perception quality and Text-to-Image misalignment. Therefore, assessing the perception quality and alignment quality of AIGIs is crucial to improving the generative model's performance. Existing assessment methods overly rely on the initial prompts in the task prompt design and use the same prompts to guide both perceptual and alignment quality evaluation, overlooking the distinctions between the two tasks. To address this limitation, we propose a novel quality assessment method for AIGIs named TSP-MGS, which designs task-specific prompts and measures multi-granularity similarity between AIGIs and the prompts. Specifically, task-specific prompts are first constructed to describe perception and alignment quality degrees separately, and the initial prompt is introduced for detailed quality perception. Then, the coarse-grained similarity between AIGIs and task-specific prompts is calculated, which facilitates holistic quality awareness. In addition, to improve the understanding of AIGI details, the fine-grained similarity between the image and the initial prompt is measured. Finally, precise quality prediction is acquired by integrating the multi-granularity similarities. Experiments on the commonly used AGIQA-1K and AGIQA-3K benchmarks demonstrate the superiority of the proposed TSP-MGS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。