用多模态对比学习,让城市空间表示更准更高效。
Multimodal Contrastive Learning of Urban Space Representations from POI Data
- 将地点嵌入与文本描述对齐,无需复杂负样本构建。
- 伦敦数据上土地利用分类准确率提升5%-15%。
- 适合城市规划、地理信息研究者使用。
现有从兴趣点(POI)数据学习城市空间表示的方法存在地理划分不精准、空间信息建模不足、语义属性利用不充分及计算效率低等问题。为此,我们提出CaLLiPer(对比语言-位置预训练)模型,直接将连续城市空间嵌入向量表示,捕捉城市环境的空间与语义分布。该模型采用多模态对比学习目标,对齐位置嵌入与文本型POI描述,避免了复杂训练语料构建和负采样。我们在英国伦敦验证了其有效性,结果显示在土地利用分类与社会经济映射任务中,预测性能相比最先进方法提升5%-15%。可视化结果表明,该模型能以高精度和细粒度捕捉城市语义的空间变化。此外,CaLLiPer还显著减少训练时间,展现良好效率与可扩展性。本工作为可扩展、语义丰富的城市空间表示学习提供了新路径,支持地理空间基础模型的发展。代码已开源:https://github.com/xlwang233/CaLLiPer。
原文摘要 · Abstract (English)
Existing methods for learning urban space representations from Point-of-Interest (POI) data face several limitations, including issues with geographical delineation, inadequate spatial information modelling, underutilisation of POI semantic attributes, and computational inefficiencies. To address these issues, we propose CaLLiPer (Contrastive Language-Location Pre-training), a novel representation learning model that directly embeds continuous urban spaces into vector representations that can capture the spatial and semantic distribution of urban environment. This model leverages a multimodal contrastive learning objective, aligning location embeddings with textual POI descriptions, thereby bypassing the need for complex training corpus construction and negative sampling. We validate CaLLiPer's effectiveness by applying it to learning urban space representations in London, UK, where it demonstrates 5-15% improvement in predictive performance for land use classification and socioeconomic mapping tasks compared to state-of-the-art methods. Visualisations of the learned representations further illustrate our model's advantages in capturing spatial variations in urban semantics with high accuracy and fine resolution. Additionally, CaLLiPer achieves reduced training time, showcasing its efficiency and scalability. This work provides a promising pathway for scalable, semantically rich urban space representation learning that can support the development of geospatial foundation models. The implementation code is available at https://github.com/xlwang233/CaLLiPer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。