用3D高斯点云高效生成多角度高光谱反射图像
BRF-GS: Hyperspectral Bidirectional Reflectance Factor Modeling and Image Generation Based on 3D Gaussian Splatting
- 基于3D高斯点云,设计混合双向反射模型提升方向反射精度
- 在三个场景的AIR-BRF数据集上实现高空间与光谱保真度
- 适合遥感、虚拟现实等需要真实反射特性的应用
双向反射因子(BRF)表征地表的定向辐射特性。现有三维辐射传输模型需复杂场景构建和计算密集型求解器,限制了多角度高光谱反射图像的高效生成。3D高斯点云(3DGS)提供了高效的神经场景表示与新视角合成框架,但其低阶球谐函数表示难以捕捉复杂方向反射特性,且高光谱数据维度高、波段间质量差异大,带来额外挑战。为此,本文提出BRF-GS,一种基于3DGS的BRF建模与高光谱反射图像生成框架。该方法引入混合BRDF驱动核以表示复杂方向反射,选择几何可靠的光谱波段进行鲁棒场景初始化,并采用两阶段训练策略,分离几何优化与光谱建模。同时构建了AIR-BRF数据集,包含三个具有自然与人工目标的多角度高光谱方向反射数据。实验表明,BRF-GS在空间与光谱保真度上表现优异,准确还原特征视图依赖的BRF响应。该框架为遥感场景中高效的数据驱动式BRF建模与多角度高光谱反射图像生成提供了新路径。
原文摘要 · Abstract (English)
The bidirectional reflectance factor (BRF) characterizes the directional radiative properties of terrestrial surfaces. However, existing three-dimensional (3D) radiative transfer models require complex scene construction and computationally intensive radiative transfer solvers, limiting efficient generation of multi-angle hyperspectral reflectance imagery. 3D Gaussian Splatting (3DGS) offers an efficient framework for neural scene representation and novel view synthesis, but its low-order spherical harmonics representation is insufficient for complex directional reflectance, while the high dimensionality and inter-band quality differences of hyperspectral data introduce additional challenges. To address these challenges, we propose BRF-GS, a 3DGS-based framework for BRF modeling and hyperspectral reflectance image generation. BRF-GS introduces a hybrid BRDF-driven kernel to represent complex directional reflectance, selects geometry-reliable spectral bands for robust 3D scene initialization, and adopts a two-stage training strategy that decouples geometry optimization from spectral modeling. We further construct the AIR-BRF dataset, a multi-angle hyperspectral directional reflectance dataset comprising three scenes with diverse natural and artificial targets. Experiments demonstrate that BRF-GS achieves superior spatial and spectral fidelity and accurately reproduces characteristic view-dependent BRF responses. The proposed framework provides an efficient data-driven approach for BRF modeling and multi-angle hyperspectral reflectance image generation in remote sensing scenes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。