让文字生成矢量图可定制风格,保持结构清晰且视觉统一。
Style Customization of Text-to-Vector Generation with Image Diffusion Priors
- 分两阶段:先用路径表示训练结构规整的生成模型,再注入图像先验实现风格迁移。
- 在多个风格下生成高质量、多样化的矢量图,支持高效前馈生成。
- 适合需要批量生成统一风格矢量图的设计人员或自动化工具开发者。
矢量图形(SVG)因其分辨率无关性和结构化层级深受设计师青睐。尽管现有文本到矢量(T2V)生成方法能从文本生成SVG,却常忽略实际应用中的关键需求——风格定制,这对保持视觉一致性与美学连贯性至关重要。现有T2V方法面临挑战:基于优化的方法可利用文本到图像(T2I)模型先验进行风格调整,但难以维持结构规整;而前馈式模型虽能保证结构,却因缺乏足够SVG训练数据而难以分离内容与风格。为此,我们提出一种新型两阶段风格定制流水线,融合前馈T2V模型与T2I图像先验的优势。第一阶段,使用路径级表示训练一个T2V扩散模型,确保SVG结构规整的同时保留丰富表达能力。第二阶段,通过蒸馏定制化T2I模型,将风格迁移到T2V模型中。该流程可在高效前馈模式下,根据文本提示生成高质量、多样且具有自定义风格的SVG。实验验证了方法的有效性。项目页面:https://customsvg.github.io。
原文摘要 · Abstract (English)
Scalable Vector Graphics (SVGs) are highly favored by designers due to their resolution independence and well-organized layer structure. Although existing text-to-vector (T2V) generation methods can create SVGs from text prompts, they often overlook an important need in practical applications: style customization, which is vital for producing a collection of vector graphics with consistent visual appearance and coherent aesthetics. Extending existing T2V methods for style customization poses certain challenges. Optimization-based T2V models can utilize the priors of text-to-image (T2I) models for customization, but struggle with maintaining structural regularity. On the other hand, feed-forward T2V models can ensure structural regularity, yet they encounter difficulties in disentangling content and style due to limited SVG training data. To address these challenges, we propose a novel two-stage style customization pipeline for SVG generation, making use of the advantages of both feed-forward T2V models and T2I image priors. In the first stage, we train a T2V diffusion model with a path-level representation to ensure the structural regularity of SVGs while preserving diverse expressive capabilities. In the second stage, we customize the T2V diffusion model to different styles by distilling customized T2I models. By integrating these techniques, our pipeline can generate high-quality and diverse SVGs in custom styles based on text prompts in an efficient feed-forward manner. The effectiveness of our method has been validated through extensive experiments. The project page is https://customsvg.github.io.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。