arXiv:2606.24484cs.CV2026-06中稿 · ECCV

构建百万级艺术字数据集并设计新模型,显著提升复杂文字识别效果。

Advancing WordArt-Oriented Scene Text Recognition: Datasets and Methods

论文配图:Advancing WordArt-Oriented Scene Text Recognition: Datasets and Methods
图 1 · 摘自论文原文
  • 用合成渲染与大模型生成结合方法构建200万条艺术字数据
  • 新模型WATERec在艺术字基准上达90.40%准确率,超越主流模型
  • 适合做艺术字识别、视觉语言模型优化的研究者参考

艺术字(WordArt)具有高度定制的字体、纹理和布局,使面向艺术字的场景文本识别(WATER)比通用场景文本识别(STR)更具挑战性。现有STR数据集和方法多基于常规文本和固定模板输入,难以拓展至WATER。为此,我们从数据与模型双角度推进该任务。数据方面,构建了规模提升数百倍的200万条合成数据集WATER-S,包含两个互补子集:一个由升级版渲染管线SynthWordArt生成,可提供高精度可控的合成艺术字;另一个通过Qwen3-VL进行提示挖掘、Z-Image实现图像合成,增强真实多样性的覆盖。模型方面,提出WATERec,采用支持任意形状输入的视觉编码器与自回归解码器,打破传统固定模板STR在复杂布局上的瓶颈。实验表明,该架构在不规则文本如艺术字上表现优异,优于以往STR方法。结合重新整理的真实数据WATER-R,新数据集与模型设计共同在WordArt-Bench上达到90.40%准确率,大幅超越通用及专用OCR视觉语言模型。代码与数据已开源。

原文摘要 · Abstract (English)

WordArt (artistic text) features highly customized fonts, textures, and layouts, making WordArt-oriented scene TExt Recognition (WATER) substantially more challenging than general Scene Text Recognition (STR). Existing STR datasets and methods, typically built around regular scene text and fixed-template inputs, struggle to scale to WATER. Thus, we aim to advance this task from both data and model perspectives. On the data side, we construct a 2M synthetic dataset, WATER-S, with the scale improved by hundreds of times compared to existing artistic text data. WATER-S consists of two complementary subsets. One rendered by an upgraded rendering pipeline (SynthWordArt), which provides highly accurate and controllable synthetic WordArt data. The other is generated by combining Qwen3-VL for prompt mining and Z-Image for image synthesis, which improves the coverage of realistic and diverse data. On the model side, we propose WATERec. It adopts an visual encoder supporting arbitrary-shaped inputs and an autoregressive decoder to model complex layouts, structurally breaking the bottleneck of fixed-template STR on WordArt. Experiments show that this architecture outperforms prior STR methods, achieving state-of-the-art performance on irregular texts such as WordArt. Together with WATER-R, carefully reorganized from existing real STR data, our strong baseline with the new synthetic data and model design reaches 90.40% accuracy on WordArt-Bench, surpassing both general-purpose and OCR-specialized vision-language models by a large margin. Code and data are available at https://github.com/YesianRohn/WATER.

艺术字识别合成数据视觉语言模型文本识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。