arXiv:2503.06678cs.CV2025-03中稿 · ACMMM 2025被引 6

Gamma统一评估多种场景图像质量,用专家混合与场景提示提升泛化能力。

Gamma: Toward Generic Image Assessment with Mixture of Assessment Experts

  • 采用专家混合模块动态学习通用与特定数据集知识。
  • 在12个数据集上覆盖6类场景,性能显著优于现有统一模型。
  • 适合需要跨场景图像质量评估的AI应用开发者使用。

图像评估旨在衡量图像的质量与美学价值,已广泛应用于自然图像和AIGC等场景。现有方法多针对特定子任务或场景,虽有研究尝试构建统一模型,但难以在多样场景中取得理想效果。本文提出Gamma——一种基于评估专家混合(MoAE)的通用图像评估模型,通过多数据集联合训练实现跨场景评估。针对不同数据集间的标注偏差问题,我们设计了共享且自适应的专家模块,动态捕捉共性与特性知识;同时引入基于场景的差异化提示(SDP),利用场景特异性提示提供先验引导,增强模型适应性。Gamma在涵盖6类图像评估场景的12个数据集上进行训练与评估。大量实验表明,其统一训练性能显著超越现有先进方法,覆盖更多场景。代码已开源:https://github.com/zht8506/Gamma。

原文摘要 · Abstract (English)

Image assessment aims to evaluate the quality and aesthetics of images and has been applied across various scenarios, such as natural and AIGC scenes. Existing methods mostly address these sub-tasks or scenes individually. While some works attempt to develop unified image assessment models, they have struggled to achieve satisfactory performance or cover a broad spectrum of assessment scenarios. In this paper, we present \textbf{Gamma}, a \textbf{G}eneric im\textbf{A}ge assess\textbf{M}ent model using \textbf{M}ixture of \textbf{A}ssessment Experts, which can effectively assess images from diverse scenes through mixed-dataset training. Achieving unified training in image assessment presents significant challenges due to annotation biases across different datasets. To address this issue, we first propose a Mixture of Assessment Experts (MoAE) module, which employs shared and adaptive experts to dynamically learn common and specific knowledge for different datasets, respectively. In addition, we introduce a Scene-based Differential Prompt (SDP) strategy, which uses scene-specific prompts to provide prior knowledge and guidance during the learning process, further boosting adaptation for various scenes. Our Gamma model is trained and evaluated on 12 datasets spanning 6 image assessment scenarios. Extensive experiments show that our unified Gamma outperforms other state-of-the-art mixed-training methods by significant margins while covering more scenes. Codes are available at https://github.com/zht8506/Gamma.

图像评估专家混合跨场景

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。