arXiv:2603.28767cs.CV2026-03被引 19

让图像生成模型学会主动搜索外部知识,提升真实场景下的生成能力。

Gen-Searcher: Reinforcing Agentic Search for Image Generation

  • 构建搜索增强型生成代理,通过多跳推理和检索获取外部知识。
  • 在KnowGen和WISE数据集上分别提升16点和15点,显著超越基线。
  • 首次开源完整数据、模型与代码,支持研究者复现与拓展。

近期图像生成模型虽能生成高保真、逼真的图像,但受限于固定的内部知识,难以应对需要外部知识或最新信息的现实场景。本文提出Gen-Searcher,首个训练搜索增强型图像生成智能体的方法,通过多跳推理与搜索获取文本知识和参考图像,实现基于外部信息的图像生成。为此,我们构建定制化数据流水线,创建两个高质量数据集:Gen-Searcher-SFT-10k 和 Gen-Searcher-RL-6k,包含多样化的搜索密集型提示及对应的真实合成图像。我们还引入KnowGen基准,明确要求模型在生成时依赖外部搜索知识,并从多个维度评估性能。基于这些资源,我们采用SFT后接双奖励反馈的智能体强化学习(GRPO),融合文本与图像奖励以提供更稳定有效的学习信号。实验表明,Gen-Searcher使Qwen-Image在KnowGen上提升约16点,在WISE上提升15点。本工作希望为图像生成中的搜索智能体提供开放基础,全部数据、模型与代码已开源。

原文摘要 · Abstract (English)

Recent image generation models have shown strong capabilities in generating high-fidelity and photorealistic images. However, they are fundamentally constrained by frozen internal knowledge, thus often failing on real-world scenarios that are knowledge-intensive or require up-to-date information. In this paper, we present Gen-Searcher, as the first attempt to train a search-augmented image generation agent, which performs multi-hop reasoning and search to collect the textual knowledge and reference images needed for grounded generation. To achieve this, we construct a tailored data pipeline and curate two high-quality datasets, Gen-Searcher-SFT-10k and Gen-Searcher-RL-6k, containing diverse search-intensive prompts and corresponding ground-truth synthesis images. We further introduce KnowGen, a comprehensive benchmark that explicitly requires search-grounded external knowledge for image generation and evaluates models from multiple dimensions. Based on these resources, we train Gen-Searcher with SFT followed by agentic reinforcement learning with dual reward feedback, which combines text-based and image-based rewards to provide more stable and informative learning signals for GRPO training. Experiments show that Gen-Searcher brings substantial gains, improving Qwen-Image by around 16 points on KnowGen and 15 points on WISE. We hope this work can serve as an open foundation for search agents in image generation, and we fully open-source our data, models, and code.

图像生成搜索增强智能体多跳推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。