arXiv:2602.09932cs.CV2026-02

用遥感数据联合预测建筑高度与轮廓,精度高且模型轻量。

GeoFormer: A Lightweight Swin Transformer for Joint Building Height and Footprint Estimation from Sentinel Imagery

  • 基于轻量Swin Transformer设计多任务框架,结合雷达与光学影像
  • 建筑高度误差仅3.19米,参数量仅0.32百万,优于传统卷积网络7.5%
  • 无需微调即可跨洲迁移,适合全球城市形态分析应用

建筑高度(BH)与轮廓(BF)是气候模拟、灾害风险评估和人口分布等应用的基础城市形态参数,但全球一致的数据仍十分稀缺。本文提出GeoFormer,一种基于轻量Swin Transformer的多任务学习框架,仅使用开放获取的哨兵1号雷达(Sentinel-1 SAR)、哨兵2号多光谱(Sentinel-2 multispectral)和数字高程模型(DEM)数据,在100米网格上联合估计建筑高度与轮廓。采用地理区块划分策略,确保54个形态多样城市的训练与测试区域在空间上严格独立。以ResNet、UNet、SENet等典型卷积神经网络为基线,全面评估其预测精度、计算效率与空间迁移能力。结果表明,GeoFormer实现3.19米的建筑高度均方根误差(RMSE),仅需0.32百万参数,较最优基线UNet提升7.5%;证明窗口化局部注意力优于卷积,适用于场景级建筑参数提取。系统消融实验显示:5×5(500米)感受野最优,DEM对高度估计不可或缺,多光谱反射率贡献主要预测信号。跨大陆迁移测试验证,无需区域微调即可保持低于3.5米的建筑高度误差。所有代码、模型权重及全球产品均已公开发布。

原文摘要 · Abstract (English)

Building height (BH) and footprint (BF) are fundamental urban morphological parameters required by climate modelling, disaster-risk assessment, and population mapping, yet globally consistent data remain scarce. In this work, we develop GeoFormer, a lightweight Swin Transformer-based multi-task learning framework that jointly estimates BH and BF on a 100 m grid using only open-access Sentinel-1 SAR, Sentinel-2 multispectral, and DEM data. A geo-blocked data-splitting strategy enforces strict spatial independence between training and evaluation regions across 54 morphologically diverse cities. We set representative CNN baselines (ResNet, UNet, SENet) as benchmarks and thoroughly evaluate GeoFormer's prediction accuracy, computational efficiency, and spatial transferability. Results show that GeoFormer achieves a BH RMSE of 3.19 m with only 0.32 M parameters -- outperforming the best CNN baseline (UNet) by 7.5% -- indicating that windowed local attention is more effective than convolution for scene-level building-parameter retrieval. Systematic ablation on context window size, model capacity, and input modality further reveals that a 5x5 (500 m) receptive field is optimal, DEM is indispensable for height estimation, and multispectral reflectance carries the dominant predictive signal. Cross-continent transfer tests confirm BH RMSE below 3.5 m without region-specific fine-tuning. All code, model weights, and the resulting global product are publicly released.

建筑高度遥感分析多任务学习轻量化模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。