用分层设计思想让AI自动组合图形元素,生成更合理的海报布局。
From Elements to Design: A Layered Approach for Automatic Graphic Design Composition
- 按语义将元素分层规划,逐层生成并融合已生成图像
- 在多个设计任务上超越专用模型,无需额外训练
- 适合需要自动排版、快速出图的设计师或非专业人士
本文研究多模态图形元素的自动设计组合。现有生成模型通常只关注特定子任务,且生成过程忽略设计的层级结构。为此,我们引入分层设计原则到大型多模态模型(LMMs)中,提出新方法LaDeCo。该方法首先对输入元素集进行分层规划,根据内容划分不同语义层;随后在分层基础上,逐层预测控制设计布局的元素属性,并将已生成层的渲染图像作为上下文输入。这一设计将复杂任务分解为可管理步骤,使生成过程更流畅清晰。实验表明,LaDeCo在设计组合任务上表现优异,还可实现分辨率调整、元素填充、设计变体等应用。尤其值得注意的是,其在部分子任务上表现优于专用模型,且无需任何任务特训。
原文摘要 · Abstract (English)
In this work, we investigate automatic design composition from multimodal graphic elements. Although recent studies have developed various generative models for graphic design, they usually face the following limitations: they only focus on certain subtasks and are far from achieving the design composition task; they do not consider the hierarchical information of graphic designs during the generation process. To tackle these issues, we introduce the layered design principle into Large Multimodal Models (LMMs) and propose a novel approach, called LaDeCo, to accomplish this challenging task. Specifically, LaDeCo first performs layer planning for a given element set, dividing the input elements into different semantic layers according to their contents. Based on the planning results, it subsequently predicts element attributes that control the design composition in a layer-wise manner, and includes the rendered image of previously generated layers into the context. With this insightful design, LaDeCo decomposes the difficult task into smaller manageable steps, making the generation process smoother and clearer. The experimental results demonstrate the effectiveness of LaDeCo in design composition. Furthermore, we show that LaDeCo enables some interesting applications in graphic design, such as resolution adjustment, element filling, design variation, etc. In addition, it even outperforms the specialized models in some design subtasks without any task-specific training.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。