arXiv:2606.26930cs.CV2026-06

用真实人脸引导强化学习,生成更逼真的肖像图。

PortraitGen: Exemplar-Driven GRPO with Dual-Reward Guidance for Photorealistic Portrait Generation

论文配图:PortraitGen: Exemplar-Driven GRPO with Dual-Reward Guidance for Photorealistic Portrait Generation
图 1 · 摘自论文原文
  • 引入真实图像突破生成边界,提升细节真实感。
  • 双奖励机制有效抑制油光、伪影等常见缺陷。
  • 专为高保真人像设计,适合影视级图像生成。

基于群体相对策略优化(GRPO)的强化学习方法在文本到图像后训练中已取得显著进展,但现有方法常偏好过度饱和等表面美学,无法解决诸如人工智能伪影和生物不真实性等关键问题。我们归因于两点:(1) 后训练阶段缺乏真实图像,导致采样局限于原始分布,难以突破生成边界;(2) 优化过程缺少针对细粒度伪影(如过油皮肤)的特定奖励。为此,我们提出PortraitGen,一种专用于高保真人像生成的新框架。首先,通过图像反演将真实图像引入GRPO采样组,获取其转移概率与潜在表示,打破生成边界;其次,设计双奖励机制:OmniReward用于通用质量评估,AI-Portrait用于人类特征保真度。此外,我们构建了PortraitBench这一综合性人像基准。大量实验表明,PortraitGen显著优于现有基线,在抑制伪影和实现前所未有的逼真度方面表现突出。

原文摘要 · Abstract (English)

Reinforcement Learning like Group Relative Policy Optimization (GRPO) has significantly advanced text-to-image post-training. However, current methods often favor superficial aesthetics, such as over-saturated colors, leaving critical flaws like AI artifacts and biological implausibilities unresolved. We attribute these limitations to two primary factors: (1) The absence of real images during post-training confines GRPO sampling to the original distribution, failing to break inherent generative boundaries; (2) the optimization process lacks specific rewards targeting fine-grained artifacts like overly oily skin and other AI artifacts. To address this, we propose PortraitGen, a novel framework tailored for photorealistic portrait generation. First, we break inherent generative boundaries by directly introducing real images into the GRPO sampling groups, where image inversion is employed to obtain their transition probabilities and latents. Second, to explicitly steer the model toward photorealism, we introduce a complementary dual-reward mechanism: OmniReward for general quality and AI-Portrait for human-centric fidelity. Furthermore, we curate PortraitBench, a comprehensive portrait-centric benchmark. Extensive experiments demonstrate that PortraitGen significantly outperforms existing baselines, effectively suppressing AI artifacts and achieving unprecedented photorealism.

人像生成强化学习高保真双奖励

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。