用建筑立面做地理参考,实现城市环境下的高效精准定位。
Spotter: Efficient Urban Visual Localization via Geo-Referenced Facade Landmarks in GPS-Degraded Environments

- 以建筑立面为全局参考,不依赖可靠GPS信号
- 在巴塞罗那实测中定位精度媲美顶尖方法,帧率显著更高
- 适合可穿戴设备在复杂城市环境中的实时定位
在密集城市环境中,机器人和可穿戴设备的精确视觉定位仍具挑战。现有方法多依赖GPS进行绝对定位,但城市峡谷中常因多径效应导致信号衰减。因此,传统视觉里程计随时间累积漂移,而地图匹配技术又难以获取可靠的GPS先验,且计算量过大,难以在边缘设备实时运行。为此,我们提出Spotter,一种鲁棒且实时的视觉定位框架,利用建筑立面作为可靠的全局地理参考,同时保留对可用GPS信号的融合能力。离线阶段,Spotter通过语义分割建筑立面,并结合多视图立体深度与地图数据,构建紧凑的度量数据库。运行时,通过级联检索与几何验证流程,匹配查询图像以恢复精细的全局相机位姿。我们在巴塞罗那多个街区采集的可穿戴智能眼镜行人序列上评估Spotter。实验结果表明,Spotter优于基于里程计的基线方法,定位精度接近当前最先进地图方法,且帧率显著更高。
原文摘要 · Abstract (English)
Accurate visual localization on robotic and wearable platforms remains challenging in dense urban environments. Existing methodologies typically rely on GPS for absolute positioning, yet GPS signals frequently degrade in urban canyons due to multipath propagation. Consequently, standard solutions like visual odometry suffer from unmitigated drift over time, while map-matching techniques struggle to acquire the reliable GPS priors they need, on top of being too computationally heavy for real-time edge execution. To address these limitations, we propose Spotter, a robuts and real-time visual localization framework that uses building facades as a reliable source of global geo-reference, while retaining the capability to integrate GPS signals when available. In an offline stage, Spotter processes Google Street View panoramas by semantically segmenting facades and pairing multi-view stereo depth with cartographic data to build a compact metric database. At runtime, query images are matched via a cascaded retrieval and geometric verification pipeline to recover fine-grained global camera localization. We benchmark Spotter on a newly collected dataset of pedestrian sequences acquired with wearable smart glasses across several districts of Barcelona. Experimental results show that Spotter outperforms odometry-based baselines and achieves localization accuracy comparable to state-of-the-art map-based methods while operating at significantly higher frame rates.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。