arXiv:2503.14908cs.GRcs.AI2025-03CVPR被引 41

用AI生成可定制的艺术海报,兼顾文字准确与视觉美感。

POSTA: A Go-to Framework for Customized Artistic Poster Generation

  • 分三模块:背景生成、布局排版、文字风格强化
  • 在文本准确率和美学质量上均超越现有模型
  • 适合电影展览等需强视觉冲击的创作场景

海报设计是视觉传播的重要媒介。以往基于深度学习的自动海报设计方法存在文字准确性差、用户定制能力弱、审美效果不足等问题,难以应用于电影、展览等艺术领域。为此,我们提出POSTA:一个由扩散模型与多模态大语言模型驱动的模块化艺术海报生成框架。该框架包含三个模块:背景扩散模型根据用户输入生成主题背景;设计MLLM生成与背景风格一致的版式与字体元素;艺术文本扩散模型对关键文字进行额外风格化处理以提升整体美感。最终输出视觉统一且富有吸引力的海报,整个流程完全模块化,支持灵活定制。为训练模型,我们构建了PosterArt数据集,包含高质量艺术海报,标注了版式、字体及像素级风格化文字分割信息。实验表明,POSTA在可控性与设计多样性方面表现优异,显著优于现有模型。

原文摘要 · Abstract (English)

Poster design is a critical medium for visual communication. Prior work has explored automatic poster design using deep learning techniques, but these approaches lack text accuracy, user customization, and aesthetic appeal, limiting their applicability in artistic domains such as movies and exhibitions, where both clear content delivery and visual impact are essential. To address these limitations, we present POSTA: a modular framework powered by diffusion models and multimodal large language models (MLLMs) for customized artistic poster generation. The framework consists of three modules. Background Diffusion creates a themed background based on user input. Design MLLM then generates layout and typography elements that align with and complement the background style. Finally, to enhance the poster's aesthetic appeal, ArtText Diffusion applies additional stylization to key text elements. The final result is a visually cohesive and appealing poster, with a fully modular process that allows for complete customization. To train our models, we develop the PosterArt dataset, comprising high-quality artistic posters annotated with layout, typography, and pixel-level stylized text segmentation. Our comprehensive experimental analysis demonstrates POSTA's exceptional controllability and design diversity, outperforming existing models in both text accuracy and aesthetic quality.

艺术海报扩散模型多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。