提出双正交引导机制,提升手写文本生成的清晰度与风格多样性。
Dual Orthogonal Guidance for Robust Diffusion-based Handwritten Text Generation
- 通过负向提示的正交投影实现更稳定的生成方向
- 在扩散过程中间阶段施加强引导,提升生成质量
- 适用于生僻词和复杂笔迹,改善可读性与多样性
基于扩散模型的手写文本生成(HTG)在常见词汇和常规风格上表现优异,但易记忆训练样本,难以应对风格变化和生成清晰度问题。标准扩散模型在难生成风格下常出现伪影或失真,影响可读性。为此,本文提出双正交引导(DOG)采样策略,将负向扰动提示投影到原始正向提示的正交方向,有效避开伪影同时保持内容意图,并促进更多样且合理的输出。与依赖无条件预测的分类器无关引导(CFG)不同,DOG在潜在空间中引入更稳定、解耦的生成方向。为控制引导强度,采用三角调度:去噪起止阶段弱引导,中间阶段强引导。在DiffusionPen和One-DM两个先进基准上的实验表明,DOG显著提升内容清晰度与风格多样性,对未登录词和挑战性笔迹亦有改进。
原文摘要 · Abstract (English)
Diffusion-based Handwritten Text Generation (HTG) approaches achieve impressive results on frequent, in-vocabulary words observed at training time and on regular styles. However, they are prone to memorizing training samples and often struggle with style variability and generation clarity. In particular, standard diffusion models tend to produce artifacts or distortions that negatively affect the readability of the generated text, especially when the style is hard to produce. To tackle these issues, we propose a novel sampling guidance strategy, Dual Orthogonal Guidance (DOG), that leverages an orthogonal projection of a negatively perturbed prompt onto the original positive prompt. This approach helps steer the generation away from artifacts while maintaining the intended content, and encourages more diverse, yet plausible, outputs. Unlike standard Classifier-Free Guidance (CFG), which relies on unconditional predictions and produces noise at high guidance scales, DOG introduces a more stable, disentangled direction in the latent space. To control the strength of the guidance across the denoising process, we apply a triangular schedule: weak at the start and end of denoising, when the process is most sensitive, and strongest in the middle steps. Experimental results on the state-of-the-art DiffusionPen and One-DM demonstrate that DOG improves both content clarity and style variability, even for out-of-vocabulary words and challenging writing styles.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。