首个原生支持卫星相机模型的高斯点渲染框架,显著提升重建精度。
RPC-GS: Gaussian Splatting with native RPC Rendering for Satellite Imagery

- 直接在RPC模型下投影高斯点与协方差,避免几何近似误差。
- 在DFC2019和IARPA2016数据集上,平均高度误差降低超30%。
- 适合遥感、卫星图像重建及高精度三维建模研究者使用。
我们提出RPC-GS,首个原生支持理性多项式相机(RPC)模型的高斯点渲染框架。RPC是现代推扫式卫星传感器成像几何的标准表示方式。以往方法为简化渲染,用透视或仿射相机近似替代RPC,导致重建中出现几何误差。RPC-GS通过在渲染过程中直接将高斯均值与协方差投影至图像坐标,避免此类近似。我们构建了一条由精心选择的地理坐标变换组成的链路,实现从渲染适配场景坐标到图像坐标的映射。针对高斯协方差矩阵的投影,推导出数值稳定的基于雅可比的投影方法,适用于部分非线性坐标变换。由于RPC无显式相机深度概念,我们引入基于度量射线的深度建模。在统一框架下对比了RPC、透视和仿射相机模型,结果表明:本方法在主流卫星基准数据集上始终达到最低重建误差,在DFC2019上相较透视与仿射模型分别降低29.6%与63.8%的平均高度误差,在IARPA2016上分别降低9.9%与37.9%。代码已开源,支持未来卫星影像领域高斯点研究。
原文摘要 · Abstract (English)
We present RPC-GS, the first Gaussian Splatting framework for satellite imagery that operates natively with Rational Polynomial Camera (RPC) models. The RPC model is the de facto standard for representing the complex imaging geometry of modern pushbroom satellite sensors. To simplify rendering, prior satellite Gaussian Splatting methods replace the RPC model with perspective or affine camera approximations, leading to geometric errors during reconstruction. RPC-GS avoids these approximations by projecting Gaussian means and covariances directly through the RPC model during the splatting process. We embed the RPC model in a chain of carefully selected geo-coordinate transformations representing a mapping from splatting-suitable scene coordinates to image coordinates. To map the Gaussian covariance matrices, we derive a numerically robust Jacobian-based covariance projection for the (partially nonlinear) coordinate transformations. Since RPCs lack an explicit notion of camera depth, we integrate a metric ray-based depth formulation. We benchmark RPC, perspective, and affine camera models in a unified framework, with our native RPC renderer consistently achieving the lowest reconstruction error on leading satellite benchmark datasets, improving mean altitude error over perspective and affine approximations by 29.6% and 63.8% on DFC2019, and by 9.9% and 37.9% on IARPA2016. We release our code to support future research of Gaussian Splatting in the satellite imaging domain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。