arXiv:2412.01137cs.CV2024-12ICCV被引 11

用扩散模型生成高精度、真实且可大规模扩展的场景文本数据,提升识别效果。

TextSSR: Diffusion-based Data Synthesis for Scene Text Recognition

  • 基于区域中心文本生成与位置字形增强,确保字符定位准确。
  • 生成355万条高质量文本实例,训练模型在主流基准上显著优于现有合成数据。
  • 无需自然语言提示,支持字符级精细控制,适合大规模数据合成任务。

场景文本识别(STR)面临合成数据不够真实或真实数据难以大规模获取的挑战,限制了模型性能。尽管扩散模型能生成视觉上吸引人的文本图像,但在大规模下难以保证实例级文本的准确性和真实性。为此,我们提出TextSSR:一种用于生成场景文本识别训练数据的新方法。TextSSR关注三个关键特性:准确性、真实性和可扩展性。通过区域中心文本生成与位置字形增强实现准确性;利用周围文本或背景的上下文提示引导风格和外观生成以保持真实性。该字符感知的扩散架构具备精确的字符级控制能力并保留语义连贯性,无需依赖自然语言提示。因此,TextSSR可通过文本组合实现大规模生成。基于此,我们构建了TextSSR-F数据集,包含355万条经质量筛选的文本实例。大量实验表明,基于TextSSR-F训练的STR模型在常见基准上显著优于现有合成数据训练的模型,且与真实数据混合使用时进一步提升性能。代码已开源。

原文摘要 · Abstract (English)

Scene text recognition (STR) suffers from challenges of either less realistic synthetic training data or the difficulty of collecting sufficient high-quality real-world data, limiting the effectiveness of trained models. Meanwhile, despite producing holistically appealing text images, diffusion-based visual text generation methods struggle to synthesize accurate and realistic instance-level text at scale. To tackle this, we introduce TextSSR: a novel pipeline for Synthesizing Scene Text Recognition training data. TextSSR targets three key synthesizing characteristics: accuracy, realism, and scalability. It achieves accuracy through a proposed region-centric text generation with position-glyph enhancement, ensuring proper character placement. It maintains realism by guiding style and appearance generation using contextual hints from surrounding text or background. This character-aware diffusion architecture enjoys precise character-level control and semantic coherence preservation, without relying on natural language prompts. Therefore, TextSSR supports large-scale generation through combinatorial text permutations. Based on these, we present TextSSR-F, a dataset of 3.55 million quality-screened text instances. Extensive experiments show that STR models trained on TextSSR-F outperform those trained on existing synthetic datasets by clear margins on common benchmarks, and further improvements are observed when mixed with real-world training data. Code is available at https://github.com/YesianRohn/TextSSR.

文本生成扩散模型数据合成STR

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。