AutoPP自动生成优化商品海报，提升点击率。
AutoPP: Towards Automated Product Poster Generation and Optimization
- 统一设计模块整合背景、文字与布局，生成连贯海报。
- 基于在线反馈，通过元素替换与IDPO优化点击率，提升显著。
- 支持全自动流程，适合电商视觉内容生产场景。
商品海报通过视觉冲击力与信息文本结合，突出产品并吸引顾客注意。然而，设计吸引人的海报并根据线上表现人工优化，耗时耗力。为此，我们提出AutoPP，一个无需人工干预的商品海报自动生成与优化管道。生成器仅依赖基础产品信息，首先使用统一设计模块将海报的三大要素（背景、文字、布局）融合为连贯输出；随后，元素渲染模块将这些要素编码为条件令牌，高效可控地生成海报。基于生成的海报，优化器利用线上反馈提升点击率（CTR），通过系统性替换元素获取细粒度CTR对比，并采用孤立直接偏好优化（IDPO）将CTR提升归因于单一元素。本工作依托AutoPP1M数据集，该数据集是专为商品海报生成与优化设计的最大规模数据集，包含一百万张高质量海报及超百万用户反馈。实验表明，AutoPP在离线与在线设置下均达到顶尖性能。代码与数据集已公开：https://github.com/JD-GenX/AutoPP
原文摘要 · Abstract (English)
Product posters blend striking visuals with informative text to highlight the product and capture customer attention. However, crafting appealing posters and manually optimizing them based on online performance is laborious and resource-consuming. To address this, we introduce AutoPP, an automated pipeline for product poster generation and optimization that eliminates the need for human intervention. Specifically, the generator, relying solely on basic product information, first uses a unified design module to integrate the three key elements of a poster (background, text, and layout) into a cohesive output. Then, an element rendering module encodes these elements into condition tokens, efficiently and controllably generating the product poster. Based on the generated poster, the optimizer enhances its Click-Through Rate (CTR) by leveraging online feedback. It systematically replaces elements to gather fine-grained CTR comparisons and utilizes Isolated Direct Preference Optimization (IDPO) to attribute CTR gains to isolated elements. Our work is supported by AutoPP1M, the largest dataset specifically designed for product poster generation and optimization, which contains one million high-quality posters and feedback collected from over one million users. Experiments demonstrate that AutoPP achieves state-of-the-art results in both offline and online settings. Our code and dataset are publicly available at: https://github.com/JD-GenX/AutoPP
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。