用检测器奖励提升文本生成图像的逼真度,解决AI图像泛化问题。
RealGen: Photorealistic Text-to-Image Generation via Detector-Guided Rewards
- 引入检测器奖励机制,从语义和特征层面量化图像伪影。
- 在真实感、细节和美学上超越GPT-Image-1等主流模型。
- 提出无人工评估基准RealBench,自动化评测真实感表现。
随着图像生成技术的发展,GPT-Image-1和Qwen-Image等先进模型在文本到图像一致性与世界知识方面已取得显著进展,但在逼真图像生成上仍存在不足。即使在简单任务中,也常生成带有明显AI痕迹的“假”图像,如皮肤过平滑、面部油光等问题。为重拾‘难以分辨真实’的目标,我们提出RealGen,一个基于检测器奖励的逼真文本到图像生成框架。RealGen结合大语言模型进行提示优化,利用扩散模型生成图像,并受对抗生成启发,引入‘检测器奖励’机制,通过语义级和特征级合成图像检测器量化伪影并评估真实性。我们采用GRPO算法优化整个生成流程,显著提升图像真实感与细节。此外,提出RealBench自动评估基准,结合检测器评分与竞技场评分,实现无需人工参与的真实感评估,结果更准确且贴近用户实际体验。实验表明,RealGen在真实感、细节与美学方面显著优于GPT-Image-1、Qwen-Image及专用模型FLUX-Krea。代码已开源:https://github.com/yejy53/RealGen。
原文摘要 · Abstract (English)
With the continuous advancement of image generation technology, advanced models such as GPT-Image-1 and Qwen-Image have achieved remarkable text-to-image consistency and world knowledge However, these models still fall short in photorealistic image generation. Even on simple T2I tasks, they tend to produce " fake" images with distinct AI artifacts, often characterized by "overly smooth skin" and "oily facial sheens". To recapture the original goal of "indistinguishable-from-reality" generation, we propose RealGen, a photorealistic text-to-image framework. RealGen integrates an LLM component for prompt optimization and a diffusion model for realistic image generation. Inspired by adversarial generation, RealGen introduces a "Detector Reward" mechanism, which quantifies artifacts and assesses realism using both semantic-level and feature-level synthetic image detectors. We leverage this reward signal with the GRPO algorithm to optimize the entire generation pipeline, significantly enhancing image realism and detail. Furthermore, we propose RealBench, an automated evaluation benchmark employing Detector-Scoring and Arena-Scoring. It enables human-free photorealism assessment, yielding results that are more accurate and aligned with real user experience. Experiments demonstrate that RealGen significantly outperforms general models like GPT-Image-1 and Qwen-Image, as well as specialized photorealistic models like FLUX-Krea, in terms of realism, detail, and aesthetics. The code is available at https://github.com/yejy53/RealGen.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。