统一控制多类设计元素,让AI更精准理解用户创意意图。
CreatiDesign: A Unified Multi-Conditional Diffusion Transformer for Creative Graphic Design
- 用统一架构融合图像、文字、布局等多元设计条件
- 40万样本数据集+新型注意力掩码,实现各条件精准定位
- 适合需要精细可控设计生成的广告与媒体创作者
图形设计在广告、营销和多媒体娱乐中至关重要。现有基于扩散模型的自动化设计方法难以同时精确响应用户提供的多种异构元素(如图像、版式、文本)组合指令,导致控制不精准或整体协调性差。为此,我们提出CreatiDesign,一个涵盖模型架构与数据构建的系统性解决方案。首先设计统一的多条件驱动架构,可灵活集成各类设计元素且对基础扩散模型改动极小;其次引入多模态注意力掩码机制,确保每类条件仅控制其指定区域,避免干扰;此外,开发全自动数据构建流水线,构建包含40万样本的新数据集,并建立全面评估基准。实验表明,CreatiDesign在忠实遵循用户意图方面显著优于现有模型。
原文摘要 · Abstract (English)
Graphic design plays a vital role in visual communication across advertising, marketing, and multimedia entertainment. Prior work has explored automated graphic design generation using diffusion models, aiming to streamline creative workflows and democratize design capabilities. However, complex graphic design scenarios require accurately adhering to design intent specified by multiple heterogeneous user-provided elements (\eg images, layouts, and texts), which pose multi-condition control challenges for existing methods. Specifically, previous single-condition control models demonstrate effectiveness only within their specialized domains but fail to generalize to other conditions, while existing multi-condition methods often lack fine-grained control over each sub-condition and compromise overall compositional harmony. To address these limitations, we introduce CreatiDesign, a systematic solution for automated graphic design covering both model architecture and dataset construction. First, we design a unified multi-condition driven architecture that enables flexible and precise integration of heterogeneous design elements with minimal architectural modifications to the base diffusion model. Furthermore, to ensure that each condition precisely controls its designated image region and to avoid interference between conditions, we propose a multimodal attention mask mechanism. Additionally, we develop a fully automated pipeline for constructing graphic design datasets, and introduce a new dataset with 400K samples featuring multi-condition annotations, along with a comprehensive benchmark. Experimental results show that CreatiDesign outperforms existing models by a clear margin in faithfully adhering to user intent.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。