arXiv:2608.10684cs.CV2026-08

提出可证明的旋转不变文本识别框架,提升多方向文字识别准确率。

Embedding Rotation Invariance for Provable Multi-Oriented Scene Text Recognition

论文配图:Embedding Rotation Invariance for Provable Multi-Oriented Scene Text Recognition
图 1 · 摘自论文原文
  • 构建旋转等变编码器与旋转不变解码器,实现理论保证的旋转不变性。
  • 在多方向数据集上精度领先第二名4.0个百分点,且推理无额外开销。
  • 适合需要高鲁棒性、低计算成本的实地文字识别场景。

多方向文本在真实场景中普遍存在,仍是场景文本识别(STR)的主要挑战。现有旋转感知方法需显式估计文本方向,但缺乏理论保障,易导致误差累积、计算成本增加和强依赖数据。本文将旋转不变性嵌入STR框架:采用编码器-解码器结构,在编码器中引入旋转等变性,在解码器中实现旋转不变性,构建全旋转不变网络。解码器侧首次证明交叉注意力机制具有旋转不变性,并据此设计旋转不变文本解码器,使视觉特征到输出文本的映射保持旋转不变。编码器侧提出旋转等变的局部-全局提取网络,融合深层等变卷积与自注意力,实现旋转等变特征提取,同时建模字符间依赖并保留细粒度视觉细节。整合后得到端到端旋转不变场景文本识别网络(RISTER)。RISTER在理论上保证旋转不变性,增强对多方向样本的鲁棒性,不引入额外推理开销,也不依赖数据驱动的方向校正。实验表明,RISTER在标准与多方向基准上均达顶尖性能,于通用多方向数据集上超越次优模型4.0个百分点。

原文摘要 · Abstract (English)

Multi-oriented text is ubiquitous in real-world scenes and remains a major challenge for scene text recognition (STR). Existing rotation-aware methods explicitly estimate text orientation. However, due to the lack of theoretical guarantees, they are prone to error accumulation, increased computational cost, and strong reliance on data. In this work, we incorporate rotation invariance into the STR framework to address these limitations. Specifically, we adopt an encoder-decoder architecture, embedding rotation equivariance in the encoder and rotation invariance in the decoder to construct a fully rotation-invariant network. On the decoder side, we first identify and prove the rotation-invariant property of the cross-attention mechanism and use it to formulate a rotation-invariant text decoder that maps visual features to output text in a rotation-invariant manner. On the encoder side, we propose a rotation-equivariant local-global extraction network that integrates deep equivariant convolutions with self-attention, enabling rotation-equivariant feature extraction while modeling inter-character dependencies and preserving fine-grained visual details. By integrating the encoder and decoder, we obtain an end-to-end Rotation-Invariant Scene Text Recognition network (RISTER). RISTER provides rotation invariance with theoretical guarantees, enhancing robustness on multi-oriented samples without introducing additional inference computation or relying on data-driven orientation correction. Experiments show that RISTER achieves state-of-the-art performance on both standard and multi-oriented benchmarks, surpassing the second-best model by 4.0 percent in accuracy on the general multi-oriented dataset.

文本识别旋转不变编码器-解码器等变网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。