让电商图像生成更精准,按设计元素分配奖励
Element-Aware Group Learning for E-Commerce Image Generation

- 按构图、背景等元素分解奖励,实现细粒度优化
- 无需额外训练,直接推导出每项元素的贡献值
- 适合需要高质量图像的电商内容创作者
图像生成与编辑的进展使提示质量成为电商业务创意的关键瓶颈。视觉语言模型(VLM)可从商品图像和元数据生成图像编辑提示,但进一步提升其提示生成能力需基于生成图像的反馈进行后训练。组相对策略优化(GRPO)是此类结果级奖励优化的自然框架。然而,它仅在完整提示层面分配信用,而图像质量往往依赖于特定设计元素,如构图、背景及卖点呈现。现有细粒度信用分配方法通常需要步骤级监督或学习到的评判器。为此,我们提出EAGLE-GRPO(Element-Aware Group Learning for E-Commerce Image Generation),将预定义元素上的组中心奖励进行分解。我们将元素级信用分配建模为核岭回归问题,并推导出闭式解,无需额外采样或独立信用分配模型。这带来了可解释的各元素优势值,实现更精确的策略更新。实验表明,EAGLE-GRPO在更长的训练步数内保持性能提升并趋于稳定,生成的提示所产电商图像质量优于现有竞争性VLM提示生成基线。
原文摘要 · Abstract (English)
Recent advances in image generation and editing have made prompt quality a key bottleneck for e-commerce creatives. Vision-language models (VLMs) can generate image-editing prompts from product images and metadata, but further improving their prompt-writing capabilities requires post-training with feedback from the generated images. Group Relative Policy Optimization (GRPO) is a natural framework for such outcome-level reward optimization. However, it assigns credit only at the full-prompt level, even though image quality often depends on specific design elements such as composition, background, and the presentation of selling points. Existing fine-grained credit assignment methods typically require step-level supervision or learned critics. To address this, we propose EAGLE-GRPO (Element-Aware Group Learning for E-Commerce Image Generation), which decomposes the group-centered reward over predefined elements. We cast element-level credit assignment as a kernel ridge regression problem and derive a closed-form solution, without additional rollouts or separate credit-assignment models. This yields interpretable per-element advantages and more precise policy updates. Experiments show that EAGLE-GRPO sustains performance gains over more training steps before plateauing and generates prompts that produce higher-quality e-commerce images than competitive VLM prompt-writing baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。