用Transformer生成稀疏点数据的高精度地形图,效果远超传统方法。
T-GMSI: A transformer-based generative model for spatial interpolation under sparse measurements
- 基于视觉Transformer提取特征,替代传统卷积方法进行地形插值。
- 在70%以上数据缺失时仍保持高精度,比普通克里金法误差降低40%。
- 无需微调即可跨区域通用,适合大范围地形建模任务。
从稀疏采样数据生成连续环境模型是空间建模中的关键挑战,尤其在地形建模方面。传统插值方法在处理稀疏数据时表现不佳。为此,我们提出一种基于Transformer的生成式空间插值模型(T-GMSI),采用视觉Transformer(ViT)架构生成数字高程模型(DEM),在稀疏条件下实现高效插值。T-GMSI以ViT取代传统卷积方法进行特征提取与插值,并引入地形特征感知损失函数以提升精度。该模型在超过70%数据缺失的情况下仍能生成高质量高程表面,在不同地貌间表现出强泛化能力,无需微调。实验验证表明,相较于普通克里金法(OK)和自然邻域法(NN),T-GMSI在机载激光雷达数据上分别将均方根误差(RMSE)降低40%和25%,在星载激光雷达数据上分别降低23%和10%;相比基于条件生成对抗网络的模型(CEDGAN),在提供的DEM数据上实现20%的RMSE改进,且无需微调。模型在大规模未见地形上的良好表现,凸显其可迁移性与广泛适用潜力。本研究确立了T-GMSI作为稀疏数据空间插值的前沿方案,并为其他稀疏数据插值问题提供新思路。
原文摘要 · Abstract (English)
Generating continuous environmental models from sparsely sampled data is a critical challenge in spatial modeling, particularly for topography. Traditional spatial interpolation methods often struggle with handling sparse measurements. To address this, we propose a Transformer-based Generative Model for Spatial Interpolation (T-GMSI) using a vision transformer (ViT) architecture for digital elevation model (DEM) generation under sparse conditions. T-GMSI replaces traditional convolution-based methods with ViT for feature extraction and DEM interpolation while incorporating a terrain feature-aware loss function for enhanced accuracy. T-GMSI excels in producing high-quality elevation surfaces from datasets with over 70% sparsity and demonstrates strong transferability across diverse landscapes without fine-tuning. Its performance is validated through extensive experiments, outperforming traditional methods such as ordinary Kriging (OK) and natural neighbor (NN) and a conditional generative adversarial network (CGAN)-based model (CEDGAN). Compared to OK and NN, T-GMSI reduces root mean square error (RMSE) by 40% and 25% on airborne lidar data and by 23% and 10% on spaceborne lidar data. Against CEDGAN, T-GMSI achieves a 20% RMSE improvement on provided DEM data, requiring no fine-tuning. The ability of model on generalizing to large, unseen terrains underscores its transferability and potential applicability beyond topographic modeling. This research establishes T-GMSI as a state-of-the-art solution for spatial interpolation on sparse datasets and highlights its broader utility for other sparse data interpolation challenges.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。