无需训练的轻量级文本识别框架,利用上下文提升准确率
A Lightweight Context-Driven Training-Free Network for Scene Text Segmentation and Recognition
- 基于上下文与注意力机制,逐像素优化文本区域
- 在多个公开数据集上性能媲美顶尖模型,资源消耗大幅降低
- 适合嵌入式设备等实时场景,部署成本极低
当前场景文本识别系统多依赖大型端到端架构,需大量训练,难以满足实时场景对内存、算力和延迟的限制。为此,本文提出一种无需训练、即插即用的新框架,结合预训练文本识别器优势,减少冗余计算。该方法通过上下文理解引入注意力分割阶段,在像素级别精细化候选文本区域,提升下游识别效果。不同于传统检测中基于特征图与源图像的块级比较,本框架利用预训练描述生成器获取场景上下文,直接生成单词预测。候选文本经语义与词汇双重评估获得最终得分,高于预设置信阈值的预测跳过复杂的端到端STR处理流程,实现快速推理并减少无效计算。在多个公开基准测试中,该方法性能与当前最优系统相当,但资源需求显著降低。
原文摘要 · Abstract (English)
Modern scene text recognition systems often depend on large end-to-end architectures that require extensive training and are prohibitively expensive for real-time scenarios. In such cases, the deployment of heavy models becomes impractical due to constraints on memory, computational resources, and latency. To address these challenges, we propose a novel, training-free plug-and-play framework that leverages the strengths of pre-trained text recognizers while minimizing redundant computations. Our approach uses context-based understanding and introduces an attention-based segmentation stage, which refines candidate text regions at the pixel level, improving downstream recognition. Instead of performing traditional text detection that follows a block-level comparison between feature map and source image and harnesses contextual information using pretrained captioners, allowing the framework to generate word predictions directly from scene context.Candidate texts are semantically and lexically evaluated to get a final score. Predictions that meet or exceed a pre-defined confidence threshold bypass the heavier process of end-to-end text STR profiling, ensuring faster inference and cutting down on unnecessary computations. Experiments on public benchmarks demonstrate that our paradigm achieves performance on par with state-of-the-art systems, yet requires substantially fewer resources.Our code can be found here: https://ritabrata04.github.io/Context-driven-STR/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。