首个乌克兰手写文本生成数据集,验证了扩散模型跨语言风格迁移能力
Diffusion-Based Ukrainian Handwritten Text Generation with Cross-Domain Style Transfer

- 基于连通域分割构建308位作者的12.6万张乌克兰手写字符图像
- 在无修改架构下实现从拉丁语到西里尔语的少样本风格迁移
- 适用于低资源文字系统研究,为非拉丁语手写生成提供基准
手写文本生成(HTG)在拉丁文字中已广泛研究,但在低资源和非拉丁书写系统中仍缺乏探索,现有模型是否可泛化至非拉丁领域尚不明确。以西里尔文中的乌克兰语为例,其既缺乏大规模带作者标注的数据集,也缺少相关实证。为此,我们利用连通域分割、质量过滤及针对未充分表示的乌克兰字符的定向过采样,构建了一个包含126,177张图像的乌克兰手写单词数据集,覆盖308位作者。我们对DiffusionPen(一个基于MobileNetV2三元组损失风格编码器与CANINE条件潜空间扩散U-Net的模型)在此数据集上进行重训练,未做架构修改,测试从拉丁语向西里尔语的直接迁移能力。在三种设置下评估跨域风格迁移:从IAM英语样本进行跨语言迁移、零样本迁移到20世纪初乌克兰手稿、以及对当代作者的少样本模仿。结果表明,模型生成了可读且风格一致的手写词图像,证明少样本潜空间扩散模型可泛化至拉丁语以外的领域。我们公开发布该数据集、训练模型与评估协议,作为可复现的作家感知型西里尔文HTG基准,为扩展其他低资源书写系统的风格化手写生成奠定基础。
原文摘要 · Abstract (English)
Handwritten text generation (HTG) conditioned on writer style has been widely studied for Latin scripts, but remains underexplored for low-resource and non-Latin writing systems, leaving open how well existing models generalise beyond the Latin domain. Cyrillic, particularly Ukrainian, lacks both large-scale writer-labeled datasets and empirical evidence of such generalisation. To address this gap, we construct a Ukrainian handwritten word dataset of 126,177 images from 308 writers using connected-component segmentation, quality filtering, and targeted oversampling of underrepresented Ukrainian characters. We retrain DiffusionPen, a MobileNetV2 triplet-loss style encoder with a CANINE-conditioned latent diffusion U-Net, on this dataset without architectural modification, testing direct transfer from Latin to Cyrillic. We evaluate cross-domain style transfer in three settings: cross-lingual transfer from IAM English samples, zero-shot transfer to an early 20th-century Ukrainian manuscript, and few-shot imitation of contemporary writers. The model produces legible, style-consistent word images, indicating that few-shot latent diffusion models generalize beyond the Latin-script domain. We release the dataset, trained models, and evaluation protocol as a reproducible benchmark for writer-aware Cyrillic HTG, providing a foundation for extending stylized HTG to other underrepresented writing systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。