arXiv:2409.16827cs.CV2024-09被引 13

提出双模块检测器,提升任意形状文本识别精度与抗噪能力。

Focus Entirety and Perceive Environment for Arbitrary-Shaped Text Detection

  • 采用自顶向下机制提取实例级特征,增强像素间一致性
  • 引入环境感知模块,聚焦邻域正样本分布,提升定位准确率
  • 在四个公开数据集上超越现有最优方法,尤其擅长多尺度文本

由于场景文本在字体、颜色、形状和大小等方面具有多样性,实现准确高效的文本检测仍具挑战。基于分割的方法因其像素级预测的灵活性成为主流,但通常采用自底向上的建模方式,易受噪声影响,且像素预测缺乏特征交互,制约检测性能。为此,本文提出一种多信息层级的任意形状文本检测器,包含焦点整体模块(FEM)和感知环境模块(PEM)。FEM 通过自顶向下策略提取实例级特征,为同一实例内的像素赋予一致的整体信息,增强像素凝聚力,并强调尺度信息以有效区分不同尺度文本。PEM 则提取区域级信息,引导模型关注像素邻域内正样本的分布,将核像素视为正样本,帮助模型区分文本与背景特征。大量实验证明,FEM 能高效处理多尺度文本,而 PEM 通过聚焦邻域信息提升像素感知精度。在四个公开数据集上的对比结果表明,所提方法优于现有最先进方法。

原文摘要 · Abstract (English)

Due to the diversity of scene text in aspects such as font, color, shape, and size, accurately and efficiently detecting text is still a formidable challenge. Among the various detection approaches, segmentation-based approaches have emerged as prominent contenders owing to their flexible pixel-level predictions. However, these methods typically model text instances in a bottom-up manner, which is highly susceptible to noise. In addition, the prediction of pixels is isolated without introducing pixel-feature interaction, which also influences the detection performance. To alleviate these problems, we propose a multi-information level arbitrary-shaped text detector consisting of a focus entirety module (FEM) and a perceive environment module (PEM). The former extracts instance-level features and adopts a top-down scheme to model texts to reduce the influence of noises. Specifically, it assigns consistent entirety information to pixels within the same instance to improve their cohesion. In addition, it emphasizes the scale information, enabling the model to distinguish varying scale texts effectively. The latter extracts region-level information and encourages the model to focus on the distribution of positive samples in the vicinity of a pixel, which perceives environment information. It treats the kernel pixels as positive samples and helps the model differentiate text and kernel features. Extensive experiments demonstrate the FEM's ability to efficiently support the model in handling different scale texts and confirm the PEM can assist in perceiving pixels more accurately by focusing on pixel vicinities. Comparisons show the proposed model outperforms existing state-of-the-art approaches on four public datasets.

文本检测分割模型多尺度注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。