用语义信息增强3D高斯点云,提升水下场景重建质量
Semantic-guided Gaussian Splatting for High-Fidelity Underwater Scene Reconstruction
- 在高斯点中加入可学习的语义特征,结合CLIP引导优化
- 在真实数据集上平均PSNR、SSIM、LPIPS均优于现有方法
- 自适应重分配点云密度,低可见区域重建更精准
水下成像受散射、衰减和观测稀疏性影响,导致信息分布极不均匀。现有3D高斯点云(3DGS)方法仅依赖光度信号优化,造成良好区域过拟合、劣质区域重建不足。本文提出SWAGSplatting,通过引入语义先验增强3DGS,每个高斯点附加可学习语义特征,由基于CLIP的区域级嵌入监督,并设计语义一致性损失,使几何结构与高层语义对齐,提升结构连贯性与显著目标边界保持能力。同时提出自适应高斯点重分配策略,根据重要性和重建误差动态调整表示容量,改善传统密集化带来的不平衡问题,有效建模低可见区域且不增加计算成本。在SeaThru-NeRF、Submerged3D和S-UW等真实数据集上的实验表明,该方法在平均PSNR、SSIM和LPIPS指标上持续优于当前最优方案,验证了语义引导在高保真水下重建中的有效性。
原文摘要 · Abstract (English)
Accurate 3D reconstruction in degraded imaging conditions remains a key challenge in photogrammetry and neural rendering. In underwater environments, spatially varying visibility caused by scattering, attenuation, and sparse observations leads to highly non-uniform information quality. Existing 3D Gaussian Splatting (3DGS) methods typically optimize primitives based on photometric signals alone, resulting in imbalanced representation, with overfitting in well-observed regions and insufficient reconstruction in degraded areas. In this paper, we propose SWAGSplatting (Semantic-guided Water-scene Augmented Gaussian Splatting), a multimodal framework that integrates semantic priors into 3DGS for robust, high-fidelity underwater reconstruction. Each Gaussian primitive is augmented with a learnable semantic feature, supervised by CLIP-based embeddings derived from region-level cues. A semantic consistency loss is introduced to align geometric reconstruction with high-level semantics, improving structural coherence and preserving salient object boundaries under challenging conditions. Furthermore, we propose an adaptive Gaussian primitive reallocation strategy that redistributes representation capacity based on both primitive importance and reconstruction error, mitigating the imbalance introduced by conventional densification. This enables more effective modeling of low-visibility regions without increasing computational cost. Extensive experiments on real-world datasets, including SeaThru-NeRF, Submerged3D, and S-UW, demonstrate that the proposed method consistently outperforms state-of-the-art approaches in terms of average PSNR, SSIM, and LPIPS. The results validate the effectiveness of integrating semantic priors for high-fidelity underwater scene reconstruction. Code is available at https://github.com/theflash987/SWAGSplatting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。