用3D高斯点云实现文字级风格控制的创意字体生成。
SplatFont3D: Structure-Aware Text-to-3D Artistic Font Generation with Part-Level Style Control
- 基于3D高斯点云与扩散模型,实现从文本生成带精细部件风格控制的3D字体。
- 在风格一致性、视觉质量和渲染速度上优于现有3D生成模型。
- 适合需要个性化3D字体设计的设计师或游戏/动画开发者。
创意字体生成(AFG)可辅助设计师创作新颖艺术字体。然而,以往研究多聚焦于平面2D字体,对个性化3D-AFG探索不足。3D-AFG不仅适用于游戏、动画等沉浸式场景,还能通过新视角渲染提升2D字体表现。不同于通用3D物体,3D字体具有强结构约束和精确语义,需细粒度部件级风格控制。为此,我们提出SplatFont3D,一种基于3D高斯点云的结构感知文本到3D艺术字体生成框架,支持从多样风格提示生成3D字体并实现部件级风格控制。首先引入Glyph2Cloud模块,逐步增强2D字形的形状与风格,并生成对应的3D点云用于高斯初始化。初始化后的3D高斯通过与预训练2D扩散模型结合的得分蒸馏采样进行优化。为实现部件级控制,提出动态组件分配策略,利用3D高斯几何先验分割部件,缓解优化过程中的漂移纠缠问题。相比NeRF,SplatFont3D在部件级风格控制上更清晰有效,且渲染效率更高。实验表明,本方法在风格-文本一致性、视觉质量与渲染效率上均超越现有3D模型。
原文摘要 · Abstract (English)
Artistic font generation (AFG) can assist human designers in creating innovative artistic fonts. However, most previous studies primarily focus on 2D artistic fonts in flat design, leaving personalized 3D-AFG largely underexplored. 3D-AFG not only enables applications in immersive 3D environments such as video games and animations, but also may enhance 2D-AFG by rendering 2D fonts of novel views. Moreover, unlike general 3D objects, 3D fonts exhibit precise semantics with strong structural constraints and also demand fine-grained part-level style control. To address these challenges, we propose SplatFont3D, a novel structure-aware text-to-3D AFG framework with 3D Gaussian splatting, which enables the creation of 3D artistic fonts from diverse style text prompts with precise part-level style control. Specifically, we first introduce a Glyph2Cloud module, which progressively enhances both the shapes and styles of 2D glyphs (or components) and produces their corresponding 3D point clouds for Gaussian initialization. The initialized 3D Gaussians are further optimized through interaction with a pretrained 2D diffusion model using score distillation sampling. To enable part-level control, we present a dynamic component assignment strategy that exploits the geometric priors of 3D Gaussians to partition components, while alleviating drift-induced entanglement during 3D Gaussian optimization. Our SplatFont3D provides more explicit and effective part-level style control than NeRF, attaining faster rendering efficiency. Experiments show that our SplatFont3D outperforms existing 3D models for 3D-AFG in style-text consistency, visual quality, and rendering efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。