用大模型生成更符合用户偏好的封面图,提升平台吸引力。
ICG: Improving Cover Image Generation via MLLM-based Prompting and Personalized Preference Alignment

- 用大模型提取标题和图片语义,结合用户偏好生成个性化提示。
- 在无标签数据下通过多奖励机制训练,显著提升图像质量和相关性。
- 可直接接入现有模型,无需标注数据,适合内容推荐系统部署。
多模态大模型(MLLM)与扩散模型(DM)的进展为AI生成内容带来新可能,但个性化封面图生成仍研究不足,而其对数字平台用户参与度至关重要。本文提出ICG框架,融合MLLM提示生成与个性化偏好对齐,实现高质量、上下文相关的封面图生成。ICG通过元标记从商品标题和参考图像中提取语义特征,经用户嵌入优化后注入扩散模型。针对缺乏标注数据的问题,采用多奖励学习策略,结合公开美学与相关性奖励及基于用户行为训练的个性化偏好模型。不同于依赖手工提示和独立模块的传统流程,ICG使用适配器实现MLLM与扩散模型的端到端训练。实验表明,ICG显著提升图像质量、语义保真度与个性化程度,增强用户吸引力,并提高下游推荐任务的离线准确率。作为即插即用的适配器,ICG兼容主流模型检查点,优化过程无需真实标签。
原文摘要 · Abstract (English)
Recent advances in multimodal large language models (MLLMs) and diffusion models (DMs) have opened new possibilities for AI-generated content. Yet, personalized cover image generation remains underexplored, despite its critical role in boosting user engagement on digital platforms. We propose ICG, a novel framework that integrates MLLM-based prompting with personalized preference alignment to generate high-quality, contextually relevant covers. ICG extracts semantic features from item titles and reference images via meta tokens, refines them with user embeddings, and injects the resulting personalized context into the diffusion model. To address the lack of labeled supervision, we adopt a multi-reward learning strategy that combines public aesthetic and relevance rewards with a personalized preference model trained from user behavior. Unlike prior pipelines relying on handcrafted prompts and disjointed modules, ICG employs an adapter to bridge MLLMs and diffusion models for end-to-end training. Experiments demonstrate that ICG significantly improves image quality, semantic fidelity, and personalization, leading to stronger user appeal and offline recommendation accuracy in downstream tasks. As a plug-and-play adapter bridging MLLMs and diffusion models, ICG is compatible with common checkpoints and requires no ground-truth labels during optimization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。