arXiv:2412.11350cs.LGstat.ML2024-12被引 9

用深度神经网络+随机特征,高效处理遥感时空数据插值。

Deep Random Features for Scalable Interpolation of Spatiotemporal Data

  • 用随机特征构建具平稳先验的深层网络,替代传统高斯过程。
  • 支持批量训练,在局部与全球尺度上均优于或相当现有方法。
  • 适合大规模遥感数据建模,且能输出可信的不确定性估计。

地球观测系统快速发展,亟需可扩展的遥感数据插值方法。高斯过程(GPs)虽为候选模型,但因可扩展性差,通常依赖诱导点近似,限制表达能力;且常假设平稳性,难以捕捉复杂模式。深度高斯过程虽可克服此问题,但训练和推断困难,仍需粗糙近似。本文采用贝叶斯深度学习框架,将时空场表示为深度神经网络,其层通过随机特征展开继承平面/球面平稳高斯过程的归纳偏置。该方法可(1)捕捉数据中的高频模式,(2)使用小批量梯度下降实现大规模训练。在多个局部与全球尺度遥感数据集上实验表明,本方法结果竞争或更优,且不确定性校准良好。

原文摘要 · Abstract (English)

The rapid growth of earth observation systems calls for a scalable approach to interpolate remote-sensing observations. These methods in principle, should acquire more information about the observed field as data grows. Gaussian processes (GPs) are candidate model choices for interpolation. However, due to their poor scalability, they usually rely on inducing points for inference, which restricts their expressivity. Moreover, commonly imposed assumptions such as stationarity prevents them from capturing complex patterns in the data. While deep GPs can overcome this issue, training and making inference with them are difficult, again requiring crude approximations via inducing points. In this work, we instead approach the problem through Bayesian deep learning, where spatiotemporal fields are represented by deep neural networks, whose layers share the inductive bias of stationary GPs on the plane/sphere via random feature expansions. This allows one to (1) capture high frequency patterns in the data, and (2) use mini-batched gradient descent for large scale training. We experiment on various remote sensing data at local/global scales, showing that our approach produce competitive or superior results to existing methods, with well-calibrated uncertainties.

时空建模深度学习遥感不确定性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。