用扩散模型生成手写笔画,同时模仿字间距和书法风格。
Layout Stroke Imitation: A Layout Guided Handwriting Stroke Generation for Style Imitation with Diffusion Model
- 引入多尺度注意力特征捕捉局部与全局书法风格。
- 显式建模字间距布局,提升手写风格一致性。
- 适合需要精准手写风格模仿的研究者或应用开发。
手写笔画生成对提升手写识别和作者排序等任务性能至关重要。现有方法虽利用书法特征,但未将字间距(字布局)作为显式特征,导致风格模仿时字间距不一致。本文提出多尺度注意力特征以增强书法风格表征,能同时捕捉局部与全局风格信息;同时引入字布局信息,指导笔画生成中的字间距控制。此外,提出条件扩散模型直接生成笔画序列,而非生成图像,保留了时间坐标信息。实验表明,该方法在笔画生成上优于当前最优模型,并在性能上可媲美最新的图像生成网络。
原文摘要 · Abstract (English)
Handwriting stroke generation is crucial for improving the performance of tasks such as handwriting recognition and writers order recovery. In handwriting stroke generation, it is significantly important to imitate the sample calligraphic style. The previous studies have suggested utilizing the calligraphic features of the handwriting. However, they had not considered word spacing (word layout) as an explicit handwriting feature, which results in inconsistent word spacing for style imitation. Firstly, this work proposes multi-scale attention features for calligraphic style imitation. These multi-scale feature embeddings highlight the local and global style features. Secondly, we propose to include the words layout, which facilitates word spacing for handwriting stroke generation. Moreover, we propose a conditional diffusion model to predict strokes in contrast to previous work, which directly generated style images. Stroke generation provides additional temporal coordinate information, which is lacking in image generation. Hence, our proposed conditional diffusion model for stroke generation is guided by calligraphic style and word layout for better handwriting imitation and stroke generation in a calligraphic style. Our experimentation shows that the proposed diffusion model outperforms the current state-of-the-art stroke generation and is competitive with recent image generation networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。