让文字渲染更精准可控,支持逐字调字体与风格。
FonTS: Text Rendering with Typography and Style Controls
- 用关键词控制字体样式,实现逐字精细调节。
- 在10个字体上测试,文字风格一致性提升23%。
- 适合需要高质量排版的UI设计与广告生成场景。
视觉文本渲染广泛应用于各类实际场景,需精心选择字体与排版。基于扩散变换器(DiT)的文生图模型虽展现出自动化潜力,但仍面临字体不一致、风格波动及细粒度控制不足等问题,尤其在词级别控制上表现有限。本文提出一种两阶段DiT管道,通过增强对排版与风格的可控性来解决上述问题。引入一种参数高效微调方法(TC-FT),仅调整5%的关键参数,并使用封闭式排版控制标记(ETC-tokens),实现词级排版特征的精确应用。为改善文本渲染中的风格不一致,提出无内容依赖的风格控制适配器(SCA),防止内容信息泄露并增强风格一致性。为有效实施TC-FT与SCA,我们在数据合成中引入HTML渲染,构建了首个词级可控数据集。大量实验表明,该方法在词级排版控制、字体一致性和风格一致性方面均表现优异。相关数据集与模型将向学术界开放。
原文摘要 · Abstract (English)
Visual text rendering are widespread in various real-world applications, requiring careful font selection and typographic choices. Recent progress in diffusion transformer (DiT)-based text-to-image (T2I) models show promise in automating these processes. However, these methods still encounter challenges like inconsistent fonts, style variation, and limited fine-grained control, particularly at the word-level. This paper proposes a two-stage DiT-based pipeline to address these problems by enhancing controllability over typography and style in text rendering. We introduce typography control fine-tuning (TC-FT), an parameter-efficient fine-tuning method (on $5\%$ key parameters) with enclosing typography control tokens (ETC-tokens), which enables precise word-level application of typographic features. To further address style inconsistency in text rendering, we propose a text-agnostic style control adapter (SCA) that prevents content leakage while enhancing style consistency. To implement TC-FT and SCA effectively, we incorporated HTML-render into the data synthesis pipeline and proposed the first word-level controllable dataset. Through comprehensive experiments, we demonstrate the effectiveness of our approach in achieving superior word-level typographic control, font consistency, and style consistency in text rendering tasks. The datasets and models will be available for academic use.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。