用双分支扩散模型让文字艺术设计更自由且易读。
VitaGlyph: Vitalizing Artistic Typography with Flexible Dual-branch Diffusion Models
- 将文字分为主体与背景,分别处理几何与纹理
- 生成结果在艺术性与可读性上均优于现有方法
- 适合需要创意文字设计的视觉设计师
艺术字体旨在以直观且可读的方式呈现输入字符的含义。现有基于文本到图像扩散模型的方法直接设计字符的整体几何与纹理,难以兼顾创意与可读性。本文提出无需训练的双分支方法VitaGlyph,实现可控几何变化下的灵活艺术字体生成。核心思想是将输入字符视为由主体与周围环境组成的场景,分别进行不同程度的几何变换渲染。通过大语言模型获取主体与背景的文本描述(知识获取),定位最匹配主体描述的部分并用语义字形优化结构(区域解析),最后以注意力机制分别生成主体与背景纹理并融合(注意力合成)。实验表明,VitaGlyph在艺术性与可读性上均表现更优,且支持多概念定制,显著提升生成效果。代码将公开。
原文摘要 · Abstract (English)
Artistic typography is a technique to visualize the meaning of input character in an imaginable and readable manner. With powerful text-to-image diffusion models, existing methods directly design the overall geometry and texture of input character, making it challenging to ensure both creativity and legibility. In this paper, we introduce a dual-branch, training-free method called VitaGlyph, enabling flexible artistic typography with controllable geometry changes while maintaining the readability. The key insight of VitaGlyph is to treat input character as a scene composed of a Subject and its Surrounding, which are rendered with varying degrees of geometric transformation. To enhance the visual appeal and creativity of the generated artistic typography, the subject flexibly expresses the essential concept of the input character, while the surrounding enriches relevant background without altering the shape, thus maintaining overall readability. Specifically, we implement VitaGlyph through a three-phase framework: (i) Knowledge Acquisition leverages large language models to design text descriptions for the subject and surrounding. (ii) Regional Interpretation detects the part that most closely matches the subject description and refines the structure via Semantic Typography. (iii) Attentional Compositional Generation separately renders the textures of the Subject and Surrounding regions and blends them in an attention-based manner. Experimental results demonstrate that VitaGlyph not only achieves better artistry and readability but also manages to depict multiple customized concepts, facilitating more creative and pleasing artistic typography generation. Our code will be made publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。