用多光谱遥感+不确定性估计,提升社会经济估算精度与可信度
Uncertainty-Aware Regression for Socio-Economic Estimation via Multi-View Remote Sensing
- 基于通用视觉模型融合三波段光谱数据,挖掘可见光外信息
- 引入异方差回归与贝叶斯建模,实现预测置信度量化
- 能识别高不确定区域,指导后续实地数据采集
遥感影像为地球观测提供了大范围的丰富光谱数据。已有研究尝试利用这些数据结合迁移学习,构建可扩展的社会经济状况估算方法,以减少对昂贵调查数据的依赖。然而,多数研究仅聚焦于白天卫星影像,因主流预训练模型多基于三波段RGB图像。因此,对可见光以外光谱波段的建模尚未充分探索。此外,遥感回归中的不确定性量化研究较少,但对更精准的目标定位和迭代采集地面真值数据至关重要。本文提出一种新框架,利用通用基础视觉模型处理遥感影像,通过组合三波段光谱数据以充分利用多光谱信息。同时采用异方差回归与贝叶斯建模生成预测不确定性估计。实验表明,该方法优于使用RGB或无结构波段选择的多光谱模型。此外,该框架可识别不确定预测结果,指导未来地面真值数据的获取。
原文摘要 · Abstract (English)
Remote sensing imagery offers rich spectral data across extensive areas for Earth observation. Many attempts have been made to leverage these data with transfer learning to develop scalable alternatives for estimating socio-economic conditions, reducing reliance on expensive survey-collected data. However, much of this research has primarily focused on daytime satellite imagery due to the limitation that most pre-trained models are trained on 3-band RGB images. Consequently, modeling techniques for spectral bands beyond the visible spectrum have not been thoroughly investigated. Additionally, quantifying uncertainty in remote sensing regression has been less explored, yet it is essential for more informed targeting and iterative collection of ground truth survey data. In this paper, we introduce a novel framework that leverages generic foundational vision models to process remote sensing imagery using combinations of three spectral bands to exploit multi-spectral data. We also employ methods such as heteroscedastic regression and Bayesian modeling to generate uncertainty estimates for the predictions. Experimental results demonstrate that our method outperforms existing models that use RGB or multi-spectral models with unstructured band usage. Moreover, our framework helps identify uncertain predictions, guiding future ground truth data acquisition.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。