arXiv:2606.18788cs.CVcs.CL2026-06

用自然语言控制生成可缩放的手写矢量图,无需特定风格训练。

HandwritingAgent: Language-Driven Handwriting Synthesis in Scalable Vector Space

论文配图:HandwritingAgent: Language-Driven Handwriting Synthesis in Scalable Vector Space
图 1 · 摘自论文原文
  • 基于大模型分析手写图像,逐笔生成SVG格式笔画序列。
  • 支持多语言、数学公式等复杂内容生成,性能超越现有模型。
  • 通过自然语言灵活控制风格,适合需要个性化手写的场景。

让机器模仿自然手写仍是一项挑战,需动态生成形状、纹理、压力和字体变化的笔画序列——不仅在不同人之间,同一人的书写中也存在差异。现有方法多采用深度学习,在线或离线设置下均受限于特定风格的架构设计、对大规模数据集的依赖、高计算成本以及难以通过自然语言灵活控制书写风格。为此,我们提出HandwritingAgent,一种语言驱动的智能体,可直接在可缩放矢量图形(SVG)格式中合成自然手写序列,无需针对特定风格进行训练。该智能体利用大型推理模型对参考手写图像进行几何分析,并在离散网格画布环境中自回归生成目标手写字形的笔画序列。生成过程以文本输入(对话式或非对话式)及参考手写图像为条件。在涵盖模仿、识别、多语言手写生成以及复杂数学与科学表达式生成等多种任务上的实验表明,HandwritingAgent在性能上达到或超过当前最先进的生成式手写模型,同时提供了更高效、可控且通用的合成方式。

原文摘要 · Abstract (English)

Teaching machines to emulate natural handwriting styles remains an open challenge, as it requires synthesizing stroke sequences that dynamically vary in shape, texture, pressure and script - not only across individuals, but also within a single person's handwriting. Attempts at this challenge have largely explored deep learning methods in both online and offline settings. However, these approaches are often constrained by style-specific architectural choices, heavy reliance on large datasets, high compute costs, and a lack of flexible control over writing styles through natural language. To this end, we introduce HandwritingAgent, a language-driven agent that can synthesize natural handwriting sequences directly in Scalable Vector Graphics (SVG) format with no need for style-specific training. The agent leverages a large reasoning model to geometrically analyse and autoregressively generate target handwritten glyphs as stroke sequences in a discrete grid canvas environment. Generation is conditioned on texts provided in either conversational or non-conversational mode, along with a reference handwriting-style image. Experiments on diverse handwriting tasks spanning imitation, recognition, multi-lingual handwriting synthesis, and generation of complex handwritten maths and science expressions indicate substantial improvement in performance, with HandwritingAgent matching or surpassing state-of-the-art generative handwriting models, while providing a more efficient, controllable, and generalizable synthesis method.

手写生成语言控制SVG大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。