arXiv:2511.18307cs.CVcs.AI2025-11

用视觉Transformer生成更像真人的个性化手写体。

ScriptViT: Vision Transformer-Based Personalized Handwriting Generation

  • 用Vision Transformer从多图学习手写全局风格特征。
  • 跨注意力融合文本与风格,生成更贴合作者笔迹的字迹。
  • 通过显著笔画分析,让风格迁移过程可解释。

风格化手写生成旨在合成既逼真又符合特定书写者风格的手写字。尽管基于GAN、Transformer和扩散模型的近期方法取得进展,但仍难以捕捉涵盖长程空间依赖性的全部作者特有属性。因此,如何在保持字形准确的同时还原一致的倾斜度、弧度或笔压等细微风格特征,仍是开放难题。本文提出统一框架,引入基于视觉Transformer的风格编码器,从多张参考图像中学习全局风格模式,更好表征手写体的长程结构特征。再通过交叉注意力机制将风格线索与目标文本结合,使生成结果更忠实于预期风格。为提升可解释性,采用显著笔画注意力分析(SSAA),揭示模型在风格迁移中关注的笔画级特征。上述组件共同实现更具风格一致性且更易理解与分析的手写合成。

原文摘要 · Abstract (English)

Styled handwriting generation aims to synthesize handwritten text that looks both realistic and aligned with a specific writer's style. While recent approaches involving GAN, transformer and diffusion-based models have made progress, they often struggle to capture the full spectrum of writer-specific attributes, particularly global stylistic patterns that span long-range spatial dependencies. As a result, capturing subtle writer-specific traits such as consistent slant, curvature or stroke pressure, while keeping the generated text accurate is still an open problem. In this work, we present a unified framework designed to address these limitations. We introduce a Vision Transformer-based style encoder that learns global stylistic patterns from multiple reference images, allowing the model to better represent long-range structural characteristics of handwriting. We then integrate these style cues with the target text using a cross-attention mechanism, enabling the system to produce handwritten images that more faithfully reflect the intended style. To make the process more interpretable, we utilize Salient Stroke Attention Analysis (SSAA), which reveals the stroke-level features the model focuses on during style transfer. Together, these components lead to handwriting synthesis that is not only more stylistically coherent, but also easier to understand and analyze.

手写生成视觉Transformer风格迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。