arXiv:2503.07871cs.CLcs.AI2025-03被引 20

构建首个融合地图几何信息的开放域地理问答数据集,支持复杂空间推理。

MapQA: Open-domain Geospatial Question Answering on Map Data

  • 基于OSM数据用SQL模板生成带几何信息的问答对。
  • 包含3154组问题,覆盖9类需空间推理的任务,如邻近判断与实体类型识别。
  • 揭示大模型在多跳推理上的瓶颈,适合地理信息与语言模型交叉研究者。

地理问答是导航和兴趣点搜索中的基础任务。现有地理问答数据集规模小、类型单一,通常仅依赖地理实体的文本描述而忽略其几何特征。扩展地理问答数据集面临的核心挑战在于地理关系的复杂性,需要整合空间结构、拓扑依赖和多跳推理能力,而多数文本型问答数据集缺乏此类特性。为此,我们提出MapQA,一个新数据集,不仅提供问答对,还包含问题中涉及地理实体的几何信息。该数据集基于两个研究区域(南加州和伊利诺伊州)的OpenStreetMap(OSM)数据,使用SQL查询模板生成3,154个问答对,涵盖九种需要地理空间推理的问题类型,如邻里推断和地理实体类型识别。相比现有数据集,MapQA在数量和多样性上均有显著提升。我们探索了两种解决方案:(1) 基于检索的语言模型,通过嵌入相似度排名候选地理实体;(2) 大语言模型(LLM),将自然语言问题和地理实体属性转换为可执行的SQL查询并对接OSM数据库。实验表明,检索方法能有效捕捉远近、方向等概念,但在显式计算(如距离)任务上表现不佳;而大模型(如GPT和Gemini)在单跳推理的SQL生成上表现优异,但在多跳推理中存在明显局限,揭示了当前地理问答系统的关键瓶颈。

原文摘要 · Abstract (English)

Geospatial question answering (QA) is a fundamental task in navigation and point of interest (POI) searches. While existing geospatial QA datasets exist, they are limited in both scale and diversity, often relying solely on textual descriptions of geo-entities without considering their geometries. A major challenge in scaling geospatial QA datasets for reasoning lies in the complexity of geospatial relationships, which require integrating spatial structures, topological dependencies, and multi-hop reasoning capabilities that most text-based QA datasets lack. To address these limitations, we introduce MapQA, a novel dataset that not only provides question-answer pairs but also includes the geometries of geo-entities referenced in the questions. MapQA is constructed using SQL query templates to extract question-answer pairs from OpenStreetMap (OSM) for two study regions: Southern California and Illinois. It consists of 3,154 QA pairs spanning nine question types that require geospatial reasoning, such as neighborhood inference and geo-entity type identification. Compared to existing datasets, MapQA expands both the number and diversity of geospatial question types. We explore two approaches to tackle this challenge: (1) a retrieval-based language model that ranks candidate geo-entities by embedding similarity, and (2) a large language model (LLM) that generates SQL queries from natural language questions and geo-entity attributes, which are then executed against an OSM database. Our findings indicate that retrieval-based methods effectively capture concepts like closeness and direction but struggle with questions that require explicit computations (e.g., distance calculations). LLMs (e.g., GPT and Gemini) excel at generating SQL queries for one-hop reasoning but face challenges with multi-hop reasoning, highlighting a key bottleneck in advancing geospatial QA systems.

地理问答空间推理大模型地图数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。