用大模型重建任意时间、任意地点的遥感反射率,覆盖所有波段。
HLS-GPT: A Generative Pretrained Transformer (GPT) for Continental-Scale NASA Harmonized Landsat and Sentinel-2 (HLS) Reflectance Reconstruction Across All Bands on Arbitrary Dates
- 基于分层Transformer架构,处理陆地和哨兵卫星不同波段配置。
- 在9年美国数据上训练,12个月时间序列中随机遮蔽50%数据进行重建。
- 对稀疏观测和复杂作物生长季均有良好表现,红边波段误差接近红光和近红外波段。
针对现有深度学习方法在光谱覆盖、地理扩展性及时间上下文上的局限,本文提出HLS-GPT,一种大规模生成式预训练Transformer模型,用于重建全波段、任意日期、任意位置的NASA谐波陆地与哨兵-2(HLS)30米地表反射率。模型采用分层Transformer结构,处理陆地与哨兵卫星的异构波段配置,输入为单像素12个月时间序列。通过从超过25万个训练像素的9年连续美国区域HLS时序数据中随机截取起始日期各异的12个月片段,并遮蔽50%有效观测值,训练模型从剩余观测中重构被遮掩的反射率。在超过6.2万个独立测试像素上评估显示,模型在多种地表条件下均表现稳健,包括复杂作物物候和稀疏不规则观测。留一观测评估下,所有波段重建均方根误差低于0.026,可见光波段相对误差低于35%,其他波段低于13%;红边波段误差与红光、近红外波段相当,尽管陆地卫星无红边波段。敏感性分析表明,当测试数据遮蔽比例为10%至50%时,性能仅轻微下降,全波段均方根误差仍低于0.028。在九个独立109×109公里的美国大陆(CONUS)HLS瓦片图像重建中,该模型优于两种传统方法及NASA-IBM Prithvi模型。
原文摘要 · Abstract (English)
Recent deep learning methods for Landsat and Sentinel-2 reflectance time series reconstruction remain limited by restricted spectral coverage, limited geographic scalability, or patch-based designs with short temporal contexts. We present HLS-GPT, a large-scale generative pretrained Transformer model for reconstructing NASA Harmonized Landsat Sentinel-2 30 m surface reflectance for all bands, any date, and any pixel location. HLS-GPT uses a hierarchical Transformer architecture to handle the different spectral band configurations of Landsat and Sentinel-2 and operates on single-pixel 12-month time series. To capture geographic and seasonal variability, the model was trained with nine years of HLS time series from more than 0.25 million training pixels across the conterminous United States. A random cropping and masking strategy extracts 12-month periods with varying start dates across epochs, masks 50% of valid observations, and trains the model to reconstruct the masked reflectance values from the remaining observations. Evaluation using more than 62,000 independent test pixels shows robust reconstruction under diverse land surface conditions, including complex crop phenology and sparse, irregular observations. Leave-one-observation-out evaluation achieved reconstruction RMSE below 0.026 for all HLS spectral bands, with relative RMSE below 35% for visible bands and below 13% for other bands. Red-edge band errors were comparable to red and near-infrared errors despite the absence of red-edge bands on Landsat. Sensitivity analyses that randomly masked 10% to 90% of test observations showed only modest degradation when 10% to 50% of observations were masked, with all-band RMSE below 0.028. Image reconstruction over nine independent 109 by 109 km CONUS HLS tiles further demonstrates that HLS-GPT outperforms two conventional methods and the NASA-IBM Prithvi model.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。