arXiv:2504.16942cs.SIcs.AI2025-04被引 8

用自监督方法学习城市空间特征嵌入,提升地理预测能力

S2Vec: Self-Supervised Geospatial Embeddings for the Built Environment

  • 将城市区域划分为S2网格,转为图像后用掩码自编码学习特征
  • 在社会经济任务上表现优于基线,地理外推效果更优
  • 适合做通用城市空间表示,可与图像特征融合使用

大规模通用的城市环境表征对地理空间人工智能至关重要。本文提出S2Vec,一种新型自监督框架,用于学习此类地理空间嵌入。S2Vec利用S2几何库将大范围区域划分为离散的S2单元,将单元内的建筑环境特征向量栅格化为图像,并对这些图像应用掩码自编码以编码特征向量。该方法生成与任务无关的嵌入,既捕捉局部特征,又保留空间关系。我们在多个大规模地理预测任务上评估S2Vec,包括随机训练测试分割(内插)和零样本地理适应(外推)。实验表明,S2Vec在社会经济任务上表现优于多个基线,尤其在地理适应任务中优势明显;环境任务仍有提升空间。我们还探索了将S2Vec嵌入与基于图像的嵌入结合,发现多模态融合通常能提升性能。结果表明,S2Vec能有效学习提供的建筑环境特征的通用地理表示,并可与其他数据模态协同增强地理人工智能。

原文摘要 · Abstract (English)

Scalable general-purpose representations of the built environment are crucial for geospatial artificial intelligence applications. This paper introduces S2Vec, a novel self-supervised framework for learning such geospatial embeddings. S2Vec uses the S2 Geometry library to partition large areas into discrete S2 cells, rasterizes built environment feature vectors within cells as images, and applies masked autoencoding on these rasterized images to encode the feature vectors. This approach yields task-agnostic embeddings that capture local feature characteristics and broader spatial relationships. We evaluate S2Vec on several large-scale geospatial prediction tasks, both random train/test splits (interpolation) and zero-shot geographic adaptation (extrapolation). Our experiments show S2Vec's competitive performance against several baselines on socioeconomic tasks, especially the geographic adaptation variant, with room for improvement on environmental tasks. We also explore combining S2Vec embeddings with image-based embeddings downstream, showing that such multimodal fusion can often improve performance. Our findings highlight how S2Vec can learn effective general-purpose geospatial representations of the built environment features it is provided, and how it can complement other data modalities in geospatial artificial intelligence.

地理嵌入自监督城市空间多模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。