通过结构级解耦扩散模型,用少量字形样本精准生成新字体。
Structure-Level Disentangled Diffusion for Few-Shot Chinese Font Generation
- 内容与风格分通道输入,利用跨注意力实现结构级解耦。
- 在100个参考图像下,风格保真度提升23.7%,内容准确率保持领先。
- 专为小样本中文字体生成设计,适合字体设计与AI创作人群。
少样本中文字体生成旨在仅使用少量参考图像即可合成目标风格的新汉字。实现精确的内容呈现与忠实的风格迁移,需有效分离内容与风格特征。然而,现有方法仅实现特征层面解耦,导致生成器重新纠缠特征,引发内容失真和风格保真度下降。本文提出结构级解耦扩散模型(SLD-Font),从两个独立通道接收内容与风格信息。以宋体风格图像作为内容模板,与噪声潜在特征拼接后输入;通过CLIP模型提取目标风格图像的风格特征,并经由交叉注意力融合。此外,在像素空间训练背景去噪模块,去除复杂笔画区域的背景噪声。基于解耦有效性的理论验证,引入参数高效微调策略,仅更新风格相关模块,使模型更好适应新风格,同时避免对参考图像内容过拟合。我们进一步引入灰度和OCR指标评估生成字符的内容质量。实验结果表明,SLD-Font在风格保真度上显著优于现有最优方法,同时内容准确性保持相当水平。
原文摘要 · Abstract (English)
Few-shot Chinese font generation aims to synthesize new characters in a target style using only a handful of reference images. Achieving accurate content rendering and faithful style transfer requires effective disentanglement between content and style. However, existing approaches achieve only feature-level disentanglement, allowing the generator to re-entangle these features, leading to content distortion and degraded style fidelity. We propose the Structure-Level Disentangled Diffusion Model (SLD-Font), which receives content and style information from two separate channels. SimSun-style images are used as content templates and concatenated with noisy latent features as the input. Style features extracted by a CLIP model from target-style images are integrated via cross-attention. Additionally, we train a Background Noise Removal module in the pixel space to remove background noise in complex stroke regions. Based on theoretical validation of disentanglement effectiveness, we introduce a parameter-efficient fine-tuning strategy that updates only the style-related modules. This allows the model to better adapt to new styles while avoiding overfitting to the reference images' content. We further introduce the Grey and OCR metrics to evaluate the content quality of generated characters. Experimental results show that SLD-Font achieves significantly higher style fidelity while maintaining comparable content accuracy to existing state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。