提出无需文本校正的端到端文字定位框架,提升复杂场景识别准确率。
Do You Need Text Rectification? Soft Attention Mask Embedding for Rectification-Free Scene Text Spotting
- 用Transformer全局感受野生成软注意力掩码,融合预测框优化边界
- 在Total-Text上达84.02% H-mean,比SOTA高1.02%且不需额外数据
- 无需字符标注或校正模块,适合实际应用中复杂形状/方向文字识别
端到端场景文字定位已因深度学习进展取得显著进步,但现有方法仍受多尺度变化、任意文字形状和复杂背景干扰影响,导致掩码提案不完整,降低识别精度。本文提出一种新型软注意力掩码嵌入模块(SAME),利用Transformer编码器的全局感受野提取高层特征并计算软注意力权重,将其分层嵌入预测掩码,生成更精确的文字边界感知掩码,有效抑制背景噪声。基于该模块,构建了SAME-Net端到端文字定位框架,既无需字符级标注,也无需辅助文本校正模块。由于软注意力机制完全可微,识别损失梯度可反向传播至检测分支,实现检测与识别目标联合优化。大量实验表明,SAME-Net在挑战性基准上表现优异:在任意形状的Total-Text数据集上达到84.02%的端到端H-mean,全词典准确率超越先前最优模型GLASS 1.02%,且未使用额外训练数据;在多方向ICDAR 2015数据集上取得83.4%的强词典结果,具有竞争力。
原文摘要 · Abstract (English)
End-to-end scene text spotting, which unifies text detection and recognition within a single framework, has witnessed remarkable progress driven by deep learning advances. However, most existing approaches still suffer from incomplete mask proposals caused by multi-scale variation, arbitrary text shapes, and complex background interference, thereby degrading recognition accuracy. In this paper, we propose a novel Soft Attention Mask Embedding module (SAME) that leverages the global receptive field of Transformer encoders to encode high-level features and compute soft attention weights, which are then hierarchically embedded with predicted masks to generate refined text-boundary-aware masks that effectively suppress background noise. Building upon this module, we present SAME-Net, a robust end-to-end text spotting framework that requires neither character-level annotations nor auxiliary text rectification modules. Since the soft attention mechanism is fully differentiable, recognition loss gradients can be back-propagated through the SAME module to the detection branch, enabling joint optimization of detection and recognition objectives. Extensive experiments on challenging benchmarks demonstrate the effectiveness of our approach: SAME-Net achieves 84.02\% end-to-end H-mean on the arbitrarily-shaped Total-Text dataset, surpassing the previous state-of-the-art GLASS by 1.02\% in full-lexicon accuracy without additional training data, and obtains competitive 83.4\% strong-lexicon results on the multi-oriented ICDAR 2015 dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。