arXiv:2607.06949cs.CV2026-07

用螺旋调制生成更逼真的手写文本,提升识别模型训练效果。

SpiS-GAN: Spiral-Modulated Handwriting Synthesis with Star Operation

论文配图:SpiS-GAN: Spiral-Modulated Handwriting Synthesis with Star Operation
图 1 · 摘自论文原文
  • 设计星形螺旋模块捕捉复杂笔画轨迹。
  • 在英、越语数据集上显著降低下游识别错误率。
  • 显式边缘约束确保笔画清晰,适合多语言手写合成。

训练鲁棒的手写识别(HTR)系统需要大量标注数据,但获取困难。合成手写生成可扩展训练集,但现有模型存在四大问题:一、基于MLP的方法因固定网格感受野难以追踪连笔;二、依赖CNN的判别器因过度下采样丢失结构细节,难检测断连;三、架构或仅支持线性特征交互,或高分辨率合成成本过高;四、缺乏显式边缘约束,常导致笔画边界模糊。为此,本文提出基于生成对抗网络的螺旋调制手写合成框架SpiS-GAN。生成器采用星形螺旋模块,结合调制椭圆螺旋全连接与星操作,高效追踪复杂笔画路径;引入螺旋调制判别器实现多域缺陷检测。此外,提出Sobel正则化边缘重建损失,提供边缘引导,确保字符清晰可读。在英文和越南语数据集上的评估显示,SpiS-GAN显著优于现有最优模型,生成图像高度真实,准确保留原作者书写风格,并有效降低下游HTR系统的错误率。

原文摘要 · Abstract (English)

Training robust handwriting recognition (HTR) systems requires massive amounts of annotated data, which is often difficult to acquire. While synthetic handwriting generation offers a practical solution to expand training sets, existing models struggle with several core issues. First, previous approaches, even MLP-based models fail to effectively trace cursive handwriting due to fixed-grid spatial receptive field. Second, their CNN-relied discriminators usually lose structural details through aggressive downsampling, making broken connections difficult to detect. Third, existing architectures are either limited to linear feature interactions or too expensive for high-resolution synthesis. Finally, existing approaches lack explicit edge constraints, often resulting in blurred stroke boundaries. To address these challenges, this study proposes a Spiral-Modulated Handwriting Synthesis framework based on Generative Adversarial Networks (SpiS-GAN). Our generator employs Star-Spiral Blocks combining proposed Modulated Elliptical SpiralFC with the star operation to capture spatial relationships and efficiently follow complex handwriting stroke trajectories, while a Spiral-Modulated discriminator is introduced for multi-domain flaws detection. Additionally, we introduce a Sobel-Regularized Edge Reconstruction Loss that provides edge guidance, ensuring every character remains clear and legible. Evaluations on the English and Vietnamese datasets demonstrate that SpiS-GAN significantly outperforms current state-of-the-art models. The generated images are highly authentic, accurately preserve the original writer's style across languages, and successfully lower error rates when training downstream HTR systems.

手写生成GAN边缘约束多语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。