arXiv:2503.00848cs.CV2025-03被引 2

针对3D高斯点云在遥感场景中高频细节丢失问题,提出渐进式频谱残差优化方法。

PSRGS:Progressive Spectral Residual of 3D Gaussian for High-Frequency Recovery

  • 通过频谱残差图分离高低频区域,分阶段优化几何与纹理。
  • 在高频区用梯度特征分裂椭球,采样率由特征响应动态决定。
  • 结合多视角感知损失,显著提升纹理细节恢复能力,适合遥感建模。

3D高斯泼溅(3D GS)在小规模单物体场景的新视角合成中表现优异,但应用于大规模遥感场景时面临挑战:运动恢复结构(SfM)生成的点云稀疏,且3D GS固有的平滑特性导致高频区域过度重建,产生大而致密的高斯椭球,引发梯度伪影。同时,几何与纹理联合优化可能导致椭球在错误位置密集化,造成其他视图伪影。为此,本文提出PSRGS,一种基于频谱残差图的渐进优化方案。首先构建频谱残差显著性图以区分低频与高频区域;低频区采用深度感知与深度平滑损失,以低阈值初始化几何;高频区则利用梯度特征,以高阈值分裂并克隆椭球,实现精细重构。采样率由特征响应与梯度损失决定。最后引入预训练网络,联合计算多视角感知损失,确保高斯椭球几何与颜色的高频细节准确恢复。在多个数据集上的实验表明,该方法在渲染质量上具有竞争力,尤其在高频纹理恢复方面表现突出。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3D GS) achieves impressive results in novel view synthesis for small, single-object scenes through Gaussian ellipsoid initialization and adaptive density control. However, when applied to large-scale remote sensing scenes, 3D GS faces challenges: the point clouds generated by Structure-from-Motion (SfM) are often sparse, and the inherent smoothing behavior of 3D GS leads to over-reconstruction in high-frequency regions, where have detailed textures and color variations. This results in the generation of large, opaque Gaussian ellipsoids that cause gradient artifacts. Moreover, the simultaneous optimization of both geometry and texture may lead to densification of Gaussian ellipsoids at incorrect geometric locations, resulting in artifacts in other views. To address these issues, we propose PSRGS, a progressive optimization scheme based on spectral residual maps. Specifically, we create a spectral residual significance map to separate low-frequency and high-frequency regions. In the low-frequency region, we apply depth-aware and depth-smooth losses to initialize the scene geometry with low threshold. For the high-frequency region, we use gradient features with higher threshold to split and clone ellipsoids, refining the scene. The sampling rate is determined by feature responses and gradient loss. Finally, we introduce a pre-trained network that jointly computes perceptual loss from multiple views, ensuring accurate restoration of high-frequency details in both Gaussian ellipsoids geometry and color. We conduct experiments on multiple datasets to assess the effectiveness of our method, which demonstrates competitive rendering quality, especially in recovering texture details in high-frequency regions.

3D重建高斯泼溅遥感建模细节恢复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。