提出新模型生成中文字体,能处理罕见和错字,提升书法生成质量。
Skeleton and Font Generation Network for Zero-shot Chinese Character Generation
- 用骨架构建+字形生成双模块,实现无内容图像的字体生成。
- 在常见字与错别字上均优于现有方法,错字生成使纠错任务准确率显著提升。
- 首次将错字生成用于数据增强,对汉字教学有实际价值。
自动中文字体生成仍具挑战性,主要因汉字数量庞大且结构复杂。现有方法存在固有偏差,导致生成与训练样本相似但略有差异的字符时,可能错误修正或忽略细微变化。为此,我们提出骨架与字形生成网络(SFGN),包含骨架构建器与字形生成器。骨架构建器利用低资源文本输入合成内容特征,实现无需内容图像的字体生成。不同于以往将字体风格视为全局嵌入的方法,我们引入字形生成器,在部首层级对齐内容与风格特征,提出全新视角。除常见字外,我们还测试了与常见字微小差异的错别字。实验表明,生成图像视觉效果优良,性能超越当前最优方法。此外,我们认为错别字生成具有重要教学意义,通过将其用于汉字纠错任务的数据增强,模拟学生学习手写汉字时接触错字的情境。纠错任务性能显著提升,验证了该方法的有效性及错别字生成的价值。
原文摘要 · Abstract (English)
Automatic font generation remains a challenging research issue, primarily due to the vast number of Chinese characters, each with unique and intricate structures. Our investigation of previous studies reveals inherent bias capable of causing structural changes in characters. Specifically, when generating a Chinese character similar to, but different from, those in the training samples, the bias is prone to either correcting or ignoring these subtle variations. To address this concern, we propose a novel Skeleton and Font Generation Network (SFGN) to achieve a more robust Chinese character font generation. Our approach includes a skeleton builder and font generator. The skeleton builder synthesizes content features using low-resource text input, enabling our technique to realize font generation independently of content image inputs. Unlike previous font generation methods that treat font style as a global embedding, we introduce a font generator to align content and style features on the radical level, which is a brand-new perspective for font generation. Except for common characters, we also conduct experiments on misspelled characters, a substantial portion of which slightly differs from the common ones. Our approach visually demonstrates the efficacy of generated images and outperforms current state-of-the-art font generation methods. Moreover, we believe that misspelled character generation have significant pedagogical implications and verify such supposition through experiments. We used generated misspelled characters as data augmentation in Chinese character error correction tasks, simulating the scenario where students learn handwritten Chinese characters with the help of misspelled characters. The significantly improved performance of error correction tasks demonstrates the effectiveness of our proposed approach and the value of misspelled character generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。