用统一模型同时生成个性化图文广告,更真实且贴合用户偏好。
Design Your Ad: Personalized Advertising Image and Text Generation with Unified Autoregressive Models

- 单个自回归框架同步生成广告图像和文字,支持跨模态理解。
- 在PAd1M数据集上,个性化生成效果优于基线方法,提升广告吸引力。
- 适合电商广告自动化、个性化推荐系统研发人员参考使用。
生成真实且符合用户偏好的广告是电商领域的关键挑战。现有方法依赖多个独立模型,通过点击率(CTR)控制图文广告生成,但缺乏跨模态感知,且仅反映平均偏好。为此,我们提出统一广告生成模型Uni-AdGen,采用单一自回归框架联合生成广告图像与文本。引入前景感知模块与指令微调,增强生成内容的真实性。为实现个性化,设计粗到细的偏好理解模块,从噪声多模态历史行为中捕捉用户兴趣,驱动定制化生成。同时构建首个大规模个性化图文广告数据集PAd1M,并提出产品背景相似性(PBS)度量以支持训练与评估。大量实验表明,该方法在通用与个性化广告生成任务中均优于基线。项目代码已开源:https://github.com/JD-GenX/Uni-AdGen。
原文摘要 · Abstract (English)
Generating realistic and user-preferred advertisements is a key challenge in e-commerce. Existing approaches utilize multiple independent models driven by click-through-rate (CTR) to controllably create attractive image or text advertisements. However, their pipelines lack cross-modal perception and rely on CTR that only reflects average preferences. Therefore, we explore jointly generating personalized image-text advertisements from historical click behaviors. We first design a Unified Advertisement Generative model (Uni-AdGen) that employs a single autoregressive framework to produce both advertising images and texts. By incorporating a foreground perception module and instruction tuning, Uni-AdGen enhances the realism of the generated content. To further personalize advertisements, we equip Uni-AdGen with a coarse-to-fine preference understanding module that effectively captures user interests from noisy multimodal historical behaviors to drive personalized generation. Additionally, we construct the first large-scale Personalized Advertising image-text dataset (PAd1M) and introduce a Product Background Similarity (PBS) metric to facilitate training and evaluation. Extensive experiments show that our method outperforms baselines in general and personalized advertisement generation. Our project is available at https://github.com/JD-GenX/Uni-AdGen.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。