用文字描述定位城市位置,不用地图点云或GPS。
TOL: Textual Localization with OpenStreetMap

- 通过文本与开放街图匹配,分粗到精两阶段定位
- 在5米、10米、25米阈值上分别提升6.53%、9.93%、8.32%
- 支持跨城市泛化,适用于无几何观测场景
自然语言为地理应用中的空间意图表达提供了直观方式。现有定位方法多依赖密集点云或高分辨率影像,而开放街图(OSM)提供紧凑且免费的地图表示,蕴含丰富的语义与结构信息,适合大规模定位。然而文本到OSM(T2O)定位仍基本未被探索。本文提出T2O定位任务,旨在仅凭文本描述在城市环境中估计准确的2D位置,无需几何观测或GNSS初始位置。为此,我们构建了TOL,一个覆盖多个大洲、多样城市环境的大规模基准数据集,包含约12.1万条文本查询与对应OSM地图块,涵盖波士顿、卡尔斯鲁厄和新加坡共约316公里的道路轨迹。我们进一步提出TOLoc,一种粗到精的定位框架,显式建模周围物体语义及其方向信息。粗粒度阶段,从文本和OSM块中提取方向感知特征,生成全局描述符以检索候选位置;细粒度阶段,联合处理查询文本与最优检索地图块,通过专用对齐模块融合文本描述符与局部地图特征,回归2-DoF位姿。实验表明,TOLoc在5米、10米、25米阈值下分别优于最先进方法6.53%、9.93%、8.32%,并在未见环境中展现强泛化能力。数据集、代码与模型将公开于:https://github.com/WHU-USI3DV/TOL。
原文摘要 · Abstract (English)
Natural language provides an intuitive way to express spatial intent in geospatial applications. While existing localization methods often rely on dense point cloud maps or high-resolution imagery, OpenStreetMap (OSM) offers a compact and freely available map representation that encodes rich semantic and structural information, making it well-suited for large-scale localization. However, text-to-OSM (T2O) localization remains largely unexplored. In this paper, we formulate the T2O localization task, which aims to estimate accurate 2D positions in urban environments from textual scene descriptions without relying on geometric observations or GNSS-based initial location. To support the proposed task, we introduce TOL, a large-scale benchmark spanning multiple continents and diverse urban environments. TOL contains approximately 121K textual queries paired with OSM map tiles and covers about 316 km of road trajectories across Boston, Karlsruhe, and Singapore. We further propose TOLoc, a coarse-to-fine localization framework that explicitly models the semantics of surrounding objects and their directional information. In the coarse stage, direction-aware features are extracted from both textual descriptions and OSM tiles to construct global descriptors, which are used to retrieve candidate locations for the query. In the fine stage, the query text and top-1 retrieved tile are jointly processed, where a dedicated alignment module fuses the textual descriptor and local map features to regress the 2-DoF pose. Experimental results demonstrate that TOLoc achieves strong localization performance, outperforming the best existing method by 6.53\%, 9.93\%, and 8.32\% at 5 m, 10 m, and 25 m thresholds, respectively, and shows strong generalization to unseen environments. Dataset, code and models will be publicly available at: https://github.com/WHU-USI3DV/TOL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。