arXiv:2409.12014cs.CV2024-09被引 7

用卫星图生成高精度地表模型,仅需3-4张图即可

BRDF-NeRF: Neural Radiance Fields with Optical Satellite Images and BRDF Modelling

  • 融合物理驱动的RPV BRDF模型,更准确模拟自然地表反照率
  • 仅用3-4张卫星图像,实现多视角新视图合成与高质量DSM生成
  • 适合遥感、地球科学领域研究者,尤其关注低视角数据建模

神经辐射场(NeRF)作为表示三维场景和估计双向反射分布函数(BRDF)的机器学习技术备受关注。然而,现有研究多集中于近距离影像,通常采用简化的微表面BRDF模型,难以准确刻画复杂地球表面特性。此外,多数NeRF方法需要大量同时采集的图像以实现高质量深度重建,这在卫星成像中极难满足。为解决上述问题,本文提出BRDF-NeRF,引入物理驱动的半经验型Rahman-Pinty-Verstraete(RPV)BRDF模型,能更真实捕捉自然表面的反射特性。同时,提出引导体素采样与深度监督机制,使在极少视角下也能实现辐射场建模。我们在两个卫星数据集上进行评估:(1) 吉布提,单时期内不同观测角度、固定太阳位置;(2) 兰州,跨多个时期、不同太阳位置与观测角度。仅使用3至4张卫星图像训练,BRDF-NeRF成功合成未见视角的新视图,并生成高质量数字表面模型(DSMs)。

原文摘要 · Abstract (English)

Neural radiance fields (NeRF) have gained prominence as a machine learning technique for representing 3D scenes and estimating the bidirectional reflectance distribution function (BRDF) from multiple images. However, most existing research has focused on close-range imagery, typically modeling scene surfaces with simplified Microfacet BRDF models, which are often inadequate for representing complex Earth surfaces. Furthermore, NeRF approaches generally require large sets of simultaneously captured images for high-quality surface depth reconstruction - a condition rarely met in satellite imaging. To overcome these challenges, we introduce BRDF-NeRF, which incorporates the physically-based semi-empirical Rahman-Pinty-Verstraete (RPV) BRDF model, known to better capture the reflectance properties of natural surfaces. Additionally, we propose guided volumetric sampling and depth supervision to enable radiance field modeling with a minimal number of views. Our method is evaluated on two satellite datasets: (1) Djibouti, captured at varying viewing angles within a single epoch with a fixed Sun position, and (2) Lanzhou, captured across multiple epochs with different Sun positions and viewing angles. Using only three to four satellite images for training, BRDF-NeRF successfully synthesizes novel views from unseen angles and generates high-quality digital surface models (DSMs).

卫星影像地表建模BRDFNeRF

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。