利用场景文字解决室内重复结构中的定位混淆问题
TextInPlace: Indoor Visual Place Recognition in Repetitive Structures with Scene Text Spotting and Verification
- 双分支架构融合视觉与文字信息,提升定位精度
- 在自建数据集Maze-with-Text上实现领先性能
- 适合需要高精度室内定位的机器人导航任务
视觉位置识别(VPR)是长期自主机器人识别已访问位置的关键能力。然而,现有方法在具有高度重复结构的室内环境中仍受限。我们观察到场景文字常出现在室内空间中,有助于区分视觉相似但实际不同的位置。受此启发,提出TextInPlace框架,通过整合场景文字检测与验证来缓解重复室内环境中的视觉模糊问题。该框架采用局部参数共享的双分支结构:VPR分支使用注意力聚合提取全局描述符用于粗粒度检索,STS分支则通过桥接文字检测器识别场景文字;最终筛选判别性文字计算文本相似度并重排序前K个检索图像。为弥合现有基于文字的重复室内场景数据集与机器人导航典型场景之间的差距,构建了名为Maze-with-Text的室内VPR基准数据集。在自建及公开数据集上的大量实验表明,TextInPlace在仅依赖外观信息的方法中表现更优。代码、模型与数据集已公开于https://github.com/HqiTao/TextInPlace。
原文摘要 · Abstract (English)
Visual Place Recognition (VPR) is a crucial capability for long-term autonomous robots, enabling them to identify previously visited locations using visual information. However, existing methods remain limited in indoor settings due to the highly repetitive structures inherent in such environments. We observe that scene texts frequently appear in indoor spaces and can help distinguish visually similar but different places. This inspires us to propose TextInPlace, a simple yet effective VPR framework that integrates Scene Text Spotting (STS) to mitigate visual perceptual ambiguity in repetitive indoor environments. Specifically, TextInPlace adopts a dual-branch architecture within a local parameter sharing network. The VPR branch employs attention-based aggregation to extract global descriptors for coarse-grained retrieval, while the STS branch utilizes a bridging text spotter to detect and recognize scene texts. Finally, the discriminative texts are filtered to compute text similarity and re-rank the top-K retrieved images. To bridge the gap between current text-based repetitive indoor scene datasets and the typical scenarios encountered in robot navigation, we establish an indoor VPR benchmark dataset, called Maze-with-Text. Extensive experiments on both custom and public datasets demonstrate that TextInPlace achieves superior performance over existing methods that rely solely on appearance information. The dataset, code, and trained models are publicly available at https://github.com/HqiTao/TextInPlace.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。