arXiv:2412.10159cs.CV2024-12中稿 · AAAI被引 11

无需复杂检测,通过局部语义引导实现任意阅读顺序的文本定位与识别。

Arbitrary Reading Order Scene Text Spotter with Local Semantics Guidance

  • 基于局部语义的自回归解码,结合起点定位与多尺度注意力机制。
  • 在InverseText、Total-Text和SCUT-CTW1500上均达先进水平,提升0.7%~2.5%。
  • 适合处理任意形状和阅读顺序的场景文本,计算成本更低。

近年来,场景文本定位受到广泛关注。现有方法多采用检测-识别范式,但常规检测模块难以确定阅读顺序,导致识别失败。重新审视自回归文本识别方法后发现,训练良好的识别器可在不依赖字符级检测的情况下,隐式感知完整词或句子的局部语义,包括文本内容与正确阅读顺序的空间信息。受此启发,我们提出局部语义引导的场景文本定位器(LSGSpotter),通过自回归方式解码字符位置与内容,由局部语义引导。具体设计两个有效模块:一是起点定位模块(SPLM),用于定位文本起始点以确定正确阅读顺序;二是多尺度自适应注意力模块(MAAM),用于自适应聚合局部区域文本特征。实验表明,LSGSpotter在InverseText基准上达到当前最优性能,同时在英文字母的任意形状文本任务中,于Total-Text和SCUT-CTW1500分别提升0.7%和2.5%。该方法在无需复杂检测的前提下,实现了任意阅读顺序文本的高效定位与识别。

原文摘要 · Abstract (English)

Scene text spotting has attracted the enthusiasm of relative researchers in recent years. Most existing scene text spotters follow the detection-then-recognition paradigm, where the vanilla detection module hardly determines the reading order and leads to failure recognition. After rethinking the auto-regressive scene text recognition method, we find that a well-trained recognizer can implicitly perceive the local semantics of all characters in a complete word or a sentence without a character-level detection module. Local semantic knowledge not only includes text content but also spatial information in the right reading order. Motivated by the above analysis, we propose the Local Semantics Guided scene text Spotter (LSGSpotter), which auto-regressively decodes the position and content of characters guided by the local semantics. Specifically, two effective modules are proposed in LSGSpotter. On the one hand, we design a Start Point Localization Module (SPLM) for locating text start points to determine the right reading order. On the other hand, a Multi-scale Adaptive Attention Module (MAAM) is proposed to adaptively aggregate text features in a local area. In conclusion, LSGSpotter achieves the arbitrary reading order spotting task without the limitation of sophisticated detection, while alleviating the cost of computational resources with the grid sampling strategy. Extensive experiment results show LSGSpotter achieves state-of-the-art performance on the InverseText benchmark. Moreover, our spotter demonstrates superior performance on English benchmarks for arbitrary-shaped text, achieving improvements of 0.7\% and 2.5\% on Total-Text and SCUT-CTW1500, respectively. These results validate our text spotter is effective for scene texts in arbitrary reading order and shape.

文本定位自回归任意阅读顺序局部语义

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。