arXiv:2501.13991cs.CVcs.AI2025-01IJCAI

用示例图自动匹配最合适的生成模型,省去人工筛选

CGI: Identifying Conditional Generative Models with Example Images

论文配图:CGI: Identifying Conditional Generative Models with Example Images
图 1 · 摘自论文原文
  • 通过用户提供的示例图,自动识别最匹配的生成模型
  • 4张示例图下92%模型识别准确,FID得分显著提升
  • 适合想快速找合适生成模型的开发者和研究者

生成模型近年来表现卓越,模型库随之涌现。现有模型库多依赖文本匹配搜索,但因模型数量庞大、描述抽象,用户难以通过阅读描述和示例图筛选合适模型。为此,本文提出条件生成模型识别(CGI),利用用户提供的示例图,自动识别最匹配的生成模型,无需手动浏览大量模型。为此,提出基于提示的模型识别方法(PMI),能精准描述模型功能并匹配需求与规格。为评估该方法并推动研究,构建了包含65个模型和9100个识别任务的基准数据集。实验与人工评估结果表明,当提供4张示例图时,92%的模型被正确识别,且生成质量显著优于基线方法。

原文摘要 · Abstract (English)

Generative models have achieved remarkable performance recently, and thus model hubs have emerged. Existing model hubs typically assume basic text matching is sufficient to search for models. However, in reality, due to different abstractions and the large number of models in model hubs, it is not easy for users to review model descriptions and example images, choosing which model best meets their needs. Therefore, it is necessary to describe model functionality wisely so that future users can efficiently search for the most suitable model for their needs. Efforts to address this issue remain limited. In this paper, we propose Conditional Generative Model Identification (CGI), which aims to provide an effective way to identify the most suitable model using user-provided example images rather than requiring users to manually review a large number of models with example images. To address this problem, we propose the PromptBased Model Identification (PMI) , which can adequately describe model functionality and precisely match requirements with specifications. To evaluate PMI approach and promote related research, we provide a benchmark comprising 65 models and 9100 identification tasks. Extensive experimental and human evaluation results demonstrate that PMI is effective. For instance, 92% of models are correctly identified with significantly better FID scores when four example images are provided.

生成模型图像识别模型搜索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。