arXiv:2609.01612cs.IRcs.CL2026-09

评测真实网页地址的地理编码能力,发现格式混乱导致准确率下降25个百分点。

MESSY STREETS: A Benchmark for Geocoding Real-World Addresses

  • 构建真实世界地址基准,包含缺失、重复、错乱等非标准形式。
  • 商业系统召回率比开源系统高49个百分点,主要因候选结果数量差异。
  • 单个识别失败的词会直接让整个查询失效,预处理可显著缩小差距。

我们提出MESSY STREETS,一个用于评估地理编码器在原始网页地址上表现的基准数据集,包含存在性验证和表面形式偏差的可控测量。与基于清洗或合成扰动地址的传统基准不同,MESSY STREETS包含表面形式偏离标准表达、成分缺失、重复、错误或不完整的地址。该数据集源自2024年12月的Web Data Commons语料库,参考位置来自OpenAddresses或OpenStreetMap。最强的商用地理编码器在召回率上比开源系统高出最多49个百分点。这一差距主要源于非标准地址上的候选返回率差异;一旦返回候选,各系统的位置精度基本相当。仅表面形式不规范就导致最高达25个百分点的召回率损失。分析Nominatim查询处理流程发现,其联合匹配机制使得单个无法识别的词会使整个查询失效。结果表明,处理噪声地址时地理编码器选择是关键设计决策,规范化与预处理可显著缩小开源与商用系统的差距。

原文摘要 · Abstract (English)

We introduce MESSY STREETS, a benchmark for evaluating geocoders on verbatim web addresses, with existence verification and controlled measurement of surface-form divergence. Unlike conventional benchmarks based on clean or synthetically perturbed addresses, MESSY STREETS contains addresses whose surface forms diverge from canonical representations and whose components may be missing, repeated, malformed, or incomplete. The benchmark is constructed from the December 2024 Web Data Commons corpus, with reference locations established from OpenAddresses or OpenStreetMap. The strongest commercial geocoders outperform open-source systems by up to 49 percentage points in recall. This gap is driven primarily by differences in candidate return rates on non-canonical addresses; once a candidate is returned, positional accuracy is broadly comparable across systems. Non-canonical surface form alone accounts for up to 25 percentage points of recall loss. Examining Nominatim's query-processing pipeline, we show that its conjunctive matching lets a single unrecognised token zero an otherwise valid query. The results demonstrate that geocoder choice is a consequential design decision for applications processing noisy address data, and that normalisation and preprocessing could substantially narrow the gap between open-source and commercial geocoders.

地理编码基准测试地址解析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。